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ABSTRACT 


In  diverse  areas  of  physics  and  engineering,  problems  arise 
which  should  properly  be  described  by  linear  differential  equations 
with  stochastic  coefficients.  Methods  are  developed  here  for  finding 
integral  expressions  for  the  second-order  statistics  (means,  correla¬ 
tion  functions  and  power  spectrum)  of  the  dependent  variable  of  an 
th 

n  order  linear  stochastic  differential  equation.  These  expressions 
constitute  a  generalization  of  the  corresponding  expressions  for 
linear  time-varying  systems  to  linear  randomly  time-varying  Bysteras. 

The  kernels  of  the  integral  expressions  for  the  statistical  measures 
of  the  solution  can  be  interpreted  as  stochastic  Green's  functions. 

In  general,  expressions  for  the  second-order  statistics  of  the 
solution  of  either  ordinary  or  partial  linear  differential  equations 
vith  stochastic  coefficients  requires  knowledge  of  all  the  moments  of 
stochastic  coefficients.  An  exceptional  case  is  that  in  which  the 
stochastic  coefficients  are  Gaussian  processes.  Then  the  knowledge 
of  che  second-order  statistics  is  sufficient  for  th®  complete  solution. 

It  is  assumed  that  the  coefficients  of  the  differential  equation 
are  separable  inco  deterministic  and  stochastic  parts,  and  the  solution 
for  the  deterministic  part  is  known.  In  the  ccse  of  a  stochastic 
ordinary  differencial  equation,  the  problem  now  becomes  a  problem  of 
solving  a  Volterra  integral  equation  with  a  stochastic  kernel.  Two 
methods  of  solution  of  t  is  integral  equation  are  considered:  the 
Neumann  series  expansion  method  and  the  degenerate  kernel  method. 

A  theorem  which  gives  sufficient  conditions  for  the  uniform  convergence 
of  the  Neumann  series  expansion  is  proved.  The  proof  of  this  theorem, 
and  the  actual  Neumann  series  expansion,  is  shown  to  be  facilitated 


If  the  order  differential  equation  is  expressed  in  the  state-space 
notation  of  control  system  theory. 

The  uniform  convergence  of  the  Neumann  series  expansion  allows 
the  solution  of  the  stochastic  differential  equation  to  be  expressed 
in  terms  of  the  resolvent  kernel  of  the  stochastic  integral  equation. 

The  ensemble  average  and  the  covariance  function  of  the  solution  are 
expressed  in  terms  of  the  corresponding  statistical  measures  of  the 
reso^'ent  kernel  and  of  the  input  process.  The  statistical  measures 
of  the  resolvent  kernel  are  functions  of  both  the  Green's  function 
of  the  deterministic  operator  and  the  appropriate  statistical  measures 
of  the  stochastic  coefficients. 

Both  the  Neumann  series  iteration  and  degenerate  kernel  approxi¬ 
mation  are  applied  to  the  investigation  of  the  propagation  of  waves 
in  a  randomly  space-  and  time-varying  medium.  Almost  all  the  previous 
work  has  used  the  so-called  quasimonochroraatic  assumption  which 
essentially  neglects  the  time  variation  of  the  medium.  Such  an  assump¬ 
tion  has  been  avoided  in  this  dissertation  and  thereby  some  consequences 
of  this  assumption  discovered.  The  source  and  the  stochastic  medium 
•re  assumed  to  be  wide-sense  stationary  stochastic  processes.  All  the 
stochastic  quantities  of  the  scalar  wave  equation  are  expressed  by 
their  spectral  representation,  and  the  equation  is  solved  for  the 
spectral  representation  of  the  scalar  wave  function.  From  the  spectral 
representation  of  the  scalar  wave  function,  its  power  spectral  density 
and  mutual  coherence  functions  can  be  found.  Both  the  Neumann  series 
expansion  snd  the  degenerate  kernel  approximation  demonstrate  the 
spreading  of  the  power  spectrum  of  the  source  hv  the  time-varying 


medium.  In  the  Neumann  series  expansion,  even  the  first-order  approxi¬ 
mation  shows  the  spreading  of  the  power  spectrum.  Higher  order 
approximations  show  further  spreading  of  the  power  spectrum.  Higher 
order  approximations  also  show  that  the  solution  contains,  in  add^lon 
to  the  wide-sense  stationary  terms,  terms  which  are  no  longer  wide- 


sense  stationary. 
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CHAPTER  I 


INTRODUCTION 

1 . 1  General  Statement  of  the  Problem 

Many  problems  of  interest  to  electrical  engineers  are  described 
by  linear  differencial  equations  with  stochastic  coefficients.  Often 
the  randomnesG  of  the  coefficients  has  been  neglected  because  no 
widely  applicable  and  tractable  mathematical  methods  have  been  known 
for  solving  such  problems.  In  this  dissertation,  an  order  linear 
differential  equation  with  such  stochastic  coefficients 

f.  y (t ,uj)  -  x(t,w)  (11) 

is  considered.  e  is  assumed  to  be  a  sum  of  an  invertible  deterministic 
operator  L  and  a  stochastic  operator  R.  The  differential  operator  f 
is  defined  on  some  doma in  teT  and  a  probability  space  (ft,Z,P).  L 
can  be  either  an  ordinary  or  a  partial  differential  operator.  Our 
approach  to  the  solution  of  (1.1)  is  to  determine  a  "stochastic  Green  a 
function"  (Adomian,  1961,  1963,  1964)  for  the  linear  stochastic  opera¬ 
tor  f  in  terms  of  a  deterministic  Green's  function  for  L  and  the 
appropriate  "statistical  measur-s"  of  the  stochastic  coefficients. 

The  term  "statistical  measures"  is  used  as  a  general  term  for  the 
quantities  that  characterize  stochastic  processes.  For  examplr, 

* 

Random  functions.  Precise  definitions  aie  given  in  Chapter  II, 
sec  t ion  2.2. 

** 

Probability  spaces  are  also  defined  m  section  2.2. 
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expec  ta  t  ion*  ,  or  averages,  spec  tm  l  densities  mv.l  correlation 
function*  ir*  statistical  measures.  Hie  li  ‘agral  kernel  which 
expresses  the  desired  statistical  mrmmr  of  an  output  process  in 
ten**  of  the  cor  respond  tng  statistical  measure  ot  xn  twuit  xnd  appro¬ 
priate  *c*t  1st  teal  measures  of  the  stochastic  coet t ic lent*  is  exiled 
the  "*  toe  hast lc  Gi ecu's  function".  In  this  thesis,  xn  i  let  stive 
method  (Adomlan,  1^07)  tor  the  construct  ton  ol  stochastic  Green's 
functions  is  investigated  xnd  applied  to  nhvsicxl  p«  hlems. 

1.2  SlJtP It  jeance  ol  the  Ihohlem 

Dtfierenlixl  equations  with  txndomlv  t  ime-vxi  v  mg  nvl  i  le  lent  S 
xrixe  naturally  In  many  piactical  i'iv'1'lem*.  Analysis  ol  seemingly 
Simple  systems  ot  ten  pioduces  such  dltieientlX!  etjual  l  on.*  .  roi 
example,  to  find  the  cm  lent  drawn  1 1  om  a  genoiatoi  with  finite 
internal  Impedance  operating  into  a  txmlomlv  t  me  -  vat  v  mg  head 
impedance  sine  must  solve  a  ditteienttal  eyju.it  ion  with  stochastic 
Csie  1  f  lc  lent »  A  large  interconnected  t>.>wei  system  is  cleat  Iv  * 
randomly  t  ime-vat  v  tng  nrtvoik  Its  i'rhavioi  and  i  ns  t  xn  t  xnrous 
states  sre  onlv  pi  dictable  in  x  statistical  sense  Ham  contiol 
system  problems  Ivave  randomly  timc-vaiving  oaixmeteis  Adaptive 
COnttol  systems  sie  typical  example*  In  otiiei  cases,  systiin  px  i  x  - 
artel  i  ate  modulated  hv  r andom  d  i  s  l  m  bance  s  The  combination  ot 
complexity  and  unceitxmtv  in  a  teal  pi  oh  lew  otten  makes  it  necessary 
to  use  stochastic  analysis  Uiori  tinm  mac  icsult  1 1  >»  unavoidaMe 
experimental  eliois  lit  Jetetmintng  thr  pxixmeteis  ot  the  l  ex  1  system 
or  it  MV  result  tins  lack  ot  pi  lot  Knowledge  ot  the  conditions  undei 


which  a  system  must  opeiste. 


In  the  lattei  esse,  statistics!  analysis 


3 


l pi  «•  t  r  i  «h  1  r  t  *  <  (hr  "wi't  s  (  s  a  sr  an.i  Ivj  u",  hrmuf  r  trir  traulcs  ot 

(hr  wot  st  vasr  analysis  .it  r  olti'r  up  i  r  a  I  t  s t  Ira  1  1  v  pr  *  *  lm  l  a  l  1  r  j 

Iti  tonr  rasrs  it  is  pi  t  r  i ah  1  r  to  nimlvif  a  romplr*  da  t  n  m  i  p  1  a  t  If 
svslrm  as  il  it  weir  a  simplrt  Fiivlwut  tt  svstr.m  Fv’r  rxamplr  a 
manv-h.'dv  prohlrni  m.iv  hr  attarivrd  hv  r  v’pa  tdr  t  l  ng  thr  l  n  t a  t  ar  t  l  on  o  t 

t  hr  pi  rdswntna  t  t  n>t  toirrs  ns  dr t r t ml n l s t 1 s  ts'rrr*  and  thr  ts'talttv  ot  1 

j 

all  smrillrl  tnt.rs  ns  inp.t.'n  totscs  Ni'tr  t  tia  t  thr  sum  of  ail  thr 
small  totii's  nwt  \  not  hr  nr  s  l  i  £  '  h  1  r  r.Mnnatrd  to  thr  lat^rt  ts’irrs,  rvrn 
1 1  r  a  oh  l  nd  l  v  tdua  1  loi .  r  h  \  1 1  s  r  t  i  is  nr  £  1  l  £  t  h  1  r  In  r  1  r  r  t  t  1  r  a  1 

r  itj{  1  nr  ri  1  t'jt ,  lltrtr  me  ai'a  logons  moh  Iritis  ,  such  as  v  siatp  l  Ira  l  rd  nrtvotk 
tuohlrnts  whnh  world  tr<;uttr  r  t  mu  1  (  a  nr  ous  s.'iuttop  .'t  a  1  a  t  mimhr: 
ot  loop  o  t  ii. Vc  cpi.it  tons  Hr  t  r  .  also,  tin  s.xttnlrxttv  van  hr  tiadrd 
lot  land  swrut  s  s 


ll>  .Isis!  1  t  IOi' 

[  x*  [hi  .»!' 

'v  r  i  samp  Its. 

a  tv  si  t  hi 

\  \  «v 

s'l  t  a  |I  t  s  IlFF  o  I 

j 

h  Ir  ms  t  u\  s'  1  \  t 

•  ^  >  (  t't  h.i  * 

(is  s*  t  !  t  r  t  «  i  t 

a  1  I'sjiiM  tor 

•  FI  ti|  <  til  a  lltlOS  f 

I  a  1  i 

w.u  r  ntoo.istn 

!  s'r  o  t  oh  1  s  i:  s  Flu  p  t  o 
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I  r  s  t  t  s'nva  ort  Is 

va  v  r  s  t  h  t  o-.  jjh  tlir  iiSn-OM’licir,  t  op  os  nhr  t  .•  ,  o  1  ,i  s  tna  s  ,  t  ut  hu  1  r  p  t  m  1  x  t  ut  r  » 
ot  s  n  nd-  w.i  t  r  t  \ipoi  ,i  i  <  >.w  rxamptrs  Fix-  piopa^at  is'is  ot  aound 

wavrs  t  III  oiiftli  w.»  t  r  t  with  i  .u  i  ii|i  t  i  mpr  l  a  t  nt  r  jiiadlrnts,  a>  t  r  t  o*  1 1  Us  t  lit  r 
ot  I  in  tmlri'i  o  .  i  oMilt  f  in  S  t  .i.  h.i  s  t  ;  s  * .  a  1  a  i  wa  vr  r  v;  ua  (  l  op  *  Vtius  t  hr 
s  t  s\  hast  n  wav  r  isjsial  ton*  air  o  t  n  trirri  to  rum  t  ,  s  ada  l  and  r  .waBuin  1  - 
0  a  t  1  on  r  p  y  t  nr  ■  :  s  t  u  I  t  h  r  t  mot  >  ,  .  t  opr  t  m.lr  I  »  t  a  i  d  1 1  £  v' t  *  t  v\  ha  »  t  1 1 

wa  v  r  r  tj  v>a  t  t  ops  .swt  \  o  t  o\  t  Oi  add  .  t  t  on*  1  t  r  ?  r  ,i  t  ,  h  t  oo  1 »  I  v' t  tit  dr  l  *  t  and  t  Pg 

\  a  t  t  on  s  t  aiv.'B  ndu 

1 1 1  .id.o.  (son  to  thi  il'.numT.i  i.'rnl  rxaaw'  it  »  »(  Ov  hast  iv  o|ifl«t£i| 
i  ^iiDt  loot  J  t  r  f  l||i'it  tv  <nt  ip  Ffvrt  s  i  t  umiair.r  P  t  a  1  tit  v)h  1  r  »»  ■  '  1  oh  »  K  s  . 

1 1  i  Mti  o  t  this,  t  lx  ►  (  o.  Ins  >  i  ,  >  oi>s  t  si  oi  a  no  i  oa .  h  has  is>  t  hr  r  n  v  l dr  l  > 
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expectations,  or  averages,  spectral  densities  and  correlation 
functions  are  statistical  measures.  The  integral  kernel  which 
expresses  the  desired  statistical  measure  of  an  output  process  in 
terms  of  the  corresponding  statistical  measure  of  an  input  and  appro¬ 
priate  statistical  measures  of  the  stochastic  coefficients  is  called 
the  "stochastic  Green's  function".  In  this  thesis,  an  iterative 
method  (Adomian,  1967)  for  the  construction  of  stochastic  Green's 
functions  is  investigated  and  applied  to  physical  problems- 

1 .2  Significance  of  the  Problem 

Differential  equations  with  randomly  time-varying  coefficients 
arise  naturally  in  many  practical  problems.  Analysis  of  seemingly 
simple  systems  often  produces  ch  d  ''ferential  equations.  For 
example,  to  find  the  current  drawn  from  a  generator  with  finite 
internal  impedance  operating  into  a  randomly  time-varying  load 
impedance  one  must  solve  a  differential  equation  with  stochastic 
coefficients.  A  large  interconnected  power  system  is  clearly  a 
randomly  time-varying  network.  Its  behavior  and  lnstar taneous 
states  are  only  predictable  in  a  statistical  sense.  Many  control 
system  problems  have  randomly  t 'me -varying  parameters.  Adaptive 
control  systems  are  typical  examples.  In  other  cases,  system  para¬ 
meters  are  modulated  by  random  disturbances.  The  combination  of 
complexity  and  uncertainty  in  a  real  problem  often  makes  it  necessary 
to  use  stochastic  analysis.  Ui  ertainty  may  result  from  una"oidable 
experimental  errors  in  determining  the  parameters  of  the  real  system 
or  it  may  recult  from  lack  of  prior  knowledge  of  the  conditions  under 
which  a  t\  stem  must  operate.  In  the  latter  case,  statistical  analysis 
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is  preferable  to  the  "worst  case  analysis",  because  the  results  of 
the  worst  case  analysis  are  often  unrealistically  pessimistic- 

In  some  cases  it  is  preferable  to  analyze  a  complex  deterministic 
system  as  if  it  were  a  simpler  stochastic  system.  For  example  a 
many-body  problem  may  be  attacked  by  considering  the  interaction  of 
the  predominating  forces  a-  deterministic  forces  and  the  totality  of 
all  smaller  forces  as  random  forces.  Note  that  the  sum  of  all  the 
small  forces  may  no.  be  negligible  compared  to  the  larger  forces,  even 
if  each  individual  force  by  itself  is  negligible.  In  electrical 
engineering,  there  are  analogous  problems,  such  as  complicated  network 
problems  which  would  require  simultaneous  solution  of  a  large  number 
of  loop  or  node  equations.  Here,  also,  the  complexity  can  be  traded 
for  randomness. 

In  addition  to  the  above  examples,  another  important  class  of 
problems  involving  stochastic  differential  equations  arises  in  almost 
all  wave  propagation  problems.  The  propagation  of  electromagnetic 
waves  through  the  atmosphere,  ionosphere,  plasmas,  turbulent  mixtures 
of  gases  and  water  vapor  are  some  examples.  The  propagation  of  sound 
weves  through  water  with  varying  temperature  gradients,  microstructure 
or  turbulence,  results  in  stochastic  scalar  wave  equations.  Thus  the 
stochastic  wave  equations  are  of  interest  to  sonar,  radar  and  communi¬ 
cation  engineers.  Furthermore,  pioper  understanding  of  stochastic 
wave  equations  may  provide  additional  research  cools  for  understanding 
various  random  media. 

In  addition  to  the  abovement ioned  examples  stochastic  operator 
equations  are  significant  in  several  fundamental  problems  of  physics. 
In  spite  of  this,  the  stochastic  operator  approach  has  not  been  widely 


i 
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used  because  of  ma thema c ica 1  diff  -ulties.  For  this  reason  it  is 
important  to  develop  tractable  mathematical  rethods  for  solving 
stochastic  differential  equations  which  arise  in  the  problems  of 
physics  and  engineering.  According  to  the  distinguished  ma  thema  t  ic  ian 
Solomon  Lefschetz  (1967),  the  study  of  stochastic  differential 
equations  is  one  of  the  fertile  but  poorly  charted  fields  ot  mathe¬ 
matical  research. 

Formulation  of  physical  problems  by  means  of  stochastic 
differential  equations  is  a  generalization  of  the  corresponding 
formulation  by  means  of  deterministic  differential  equations. 
Conversely,  ore  may  consider  all  the  coefficients  of  any  differential 
equation  to  be  random  variables  or  functions;  then,  when  the  randomness 
of  the  coefficients  vanishes,  the  problem  reduces  to  the  deterministic 
case,  i.e.,  the  random  coefficients  are  replaced  with  their  mean 
values.  Problems  which  need  to  be  investigated  include  the  determin¬ 
ation  of  whether  randomness  can  be  neglected  in  a  given  problem  and 
what  errors  may  result  if  this  is  done.  A  realistic  approach  to 
such  an  investigation  would  be  to  introduce  the  coefficierc  as  a 
random  variable ,  obtain  the  "random  solution"  of  the  differential 
equation,  and  then  study  its  statistical  properties.  The  general 
approach  to  this  problem  is  discusseJ  later  in  thi6  chapter. 

1 . 3  Previous  Related  Work 

Before  reviewing  the  previous  related  work  in  the  theory  of 
stochastic  equations,  some  terminology  needs  to  be  clarified.  The 
solution  of  a  differential  equation  can  be  random  for  any  of  three 


reasons ; 
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1)  Initial  or  boundary  conditions  are  random. 

2)  Forc'ng  functions  are  stochastic  processes 

3)  The  coefficients  of  the  differential  equation  are  stochastic 
processes . 

In  the  first  cwo  cases,  the  differential  equation  itself  is 
deterministic  and  the  solution  of  the  differential  equation  can  be 
expressed  in  terms  of  a  deterministic  Green's  function  and  random 
forcing  functions,  or  random  initial  and  boundary  conditions.  The 
random  initial  and  boundary  conditions  may  simply  be  interpreted  as 
random  forcing  functions  in  the  construction  of  the  Green's  function. 
For  this  reason,  the  first  two  cases  are  not  really  stochastic  differ¬ 
ential  equations.  Two  stochastic  ocesses  are  simply  related  by 
a  de  ermir 4  -  tic  Green's  function.  In  this  dissertation,  the  term 
"stochastic  differential  equation"  means  a  differential  equation 
with  coefficients  which  are  stochastic  processes.  Similarly,  a 
atochustic  integral  equation  is  an  integral  equation  with  a  stochastic 
kernel.  In  general,  a  "stochastic  operator"  is  an  operator  with 
stochastic  parameters. 

For  the  first  two  cases,  an  excellent  itview  of  the  solution  of 
differential  equations  with  random  initial  conditions  and  ’•-rdom 
forcing  functions  has  been  made  by  R.  Syski  (1967).  Other  useful 
survey  papers  are  by  Kampe  de  Ferriet  (1965)  and  an  older  one  by 
Edwards  and  Moyal  (1955).  Syski  (1967)  also  reviews  other  special 
topics  such  as  Brownian  mot.on  problems  or  Wiener-Levy  processes. 
Important  mathematical  contributions  in  connection  with  the  Wiener- 
Levy  processes  have  been  made  by  Kolmogorov,  Feller,  Levy,  Doob, 
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Kac,  Ito  and  others.  Syski  also  reviews  the  work  that  has  been  done 
by  Ito  and  Doob  in  characterizing  Markoff  diffusion  processes  The 
computation  of  the  output  spectral  density  and  the  correlation  function 
for  linear  time  -  invar ia nt  systems  has  been  thoroughly  discussed  in 
standard  texts  (Laning  and  Batcin,  1956;  Davenport  and  Root,  1958; 
and  Papoulis,  1965)  and  needs  no  further  comment. 

Among  the  other  works  in  this  line,  A.  D.  Jacobson  (1967)  in  two 
recent  papers  analyzes  second-order  coherence  properties  of  electro¬ 
magnetic  fields  which  are  produced  by  random  sources  of  arbitrary 
spectral  width.  His  principal  field  quantity,  "the  dyadic  field 
spectral  density"  is  interpreted  from  both  a  statistical  and  a 
physical  standpoint. 

Also,  random  boundary  conditions  have  been  used  by  D.  E.  Barrick 
(1965)  to  study  backscattering  of  electromagnetic  waves  from  rough 
surfaces.  The  starting  point  of  his  analysis  is  the  Chu-Stratton 
vector  integral  equation.  He  obtains  closed  form  solutions  for  the 
backscattering  cross  sections  for  "  class  of  rough  surfaces  with 
several  different  statistical  models .  Barrick's  dissertation  also 
contains  an  extensive  list  of  references  on  backscattering  of 
electromagnetic  wave,  fr  n  rough  surfaces.  Another  random  boundary 
value  problem  which  has  been  studi  d  by  several  workers  is  the 
backscattering  of  sound  waves  from  turbulent  sea  surface  (Eckart,  1953; 
and  Clay  ,  1960) . 

The  study  of  linear  differential  equations  with  stochastic 
coefficients  (or,  in  the  more  general  case,  linear  stochastic  operators) 
has  proceeded  along  two  lines.  The  first  one,  explicit  solutions  of 
specific  problems  of  physics  and  engineering  have  been  pursued  by 
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Roser.bloom  (1954).  Tikhonov  (1958),  Samuels  and  Erdingen  (1959), 

Astrom  (1965),  Chelpanov  (1962),  Adomian  (1961,  196J,  1964)  and  others. 
The  most  general  approach  to  the  subject  has  been  taken  by  Adomian. 

The  second  approach  has  been  based  on  probabilistic  functional  analysis 
and  has  been  concerned  with  proving  existence  and  uniqueness  theorems. 
Work  along  this  line  has  been  done  by  Hans  (1961),  Spacek  (1955)  and 
Bh^rucha-Re id  (1960,  1964,  1965).  As  the  theory  of  linear  stochastic 
operators  matures,  it  is  expected  that  the  two  lines  of  research  will 
merge . 

th 

Samuels  and  Eringeri  (1959)  treated  the  problem  of  an  n  Older 
linear  differential  equation  with  random  coefficients.  They  restricted 
their  attention  to  differential  equations  with  (i)  small  randomly 
varying  parameters,  (ii)  slowly  varying  random  coefficients,  and 
(iii)  only  one  random  coefficient.  They  applied  their  mathematical 
methods  to  an  RLC  circuit  with  a  randomly  varying  capacitor  and  to 
the  analysis  of  dynamic  instability  of  an  eleastic  bar  subject  to 
a  randomly  time-varying  axial  force.  They  used  a  perturbation 
method  to  solve  the  problem.  Tikhonov  (1958)  has  calculated  the 
statistics  of  the  solution  of  a  first-order,  iinear,  differential 
equation  with  a  single  stochastic  coefficient  and  a  stochastic  forcing 
function.  He  assumed  that  the  coefficient  and  forcing  function  were 
correlated,  stationary  and  normally  distributed.  Tikhonov  point6  out 
that  sometimes  it  is  possible  to  analyze  the  effects  of  a  random 
forcing  function  on  nonlinear  systems  by  considering  the  solution  of 
the  abovement ioned  linear  differential  equation.  Astrom  (1965)  also 
considers  a  first  order  stochastic  differential  equation  with 
correlated  iorcing  function  and  coefficient.  Thi6  problem  arose  in  the 
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study  of  control  systems  subject  to  random  distrubanccs .  His 
analysis  emphasized  the  probability  distributions,  where  Tikhonov's 
work  stressed  correlation  functions.  Caughey  and  Dienes  (196?) 
considered  an  nC^  order  linear  differential  equation  with  the  forcing 
function  and  lowest  order  coefficient  being  white-noise  processes. 

Syski  (1967)  reviews  several  other  special  differential  equations 
with  stochastic  coefficients  that  have  been  solved.  Other  special 
problems  have  also  been  solved.  For  example,  Gibson  (1967)  obtained 
a  solution  to  a  partial  differential  equation  with  random  coefficients. 
The  differential  equation  arose  in  calculation  of  interaction  of 
electromagnetic  waves  ar.d  the  random  fluctuation  of  electron  density 
in  the  wake  of  a  reentry  vehicle.  The  coefficients  of  the  equation 
were  cssumed  to  be  identically  distributed  Gaussian  random  variables. 

In  addition  to  the  abovementioned  methods,  hierarchy  techniques 
have  been  widely  used  by  physicists  for  solution  of  differential 
equations  with  stochastic  coefficients  (Adomian,  1967;  Adomian,  1968; 
Keller,  1964;  Richardson,  1964;  and  Kraichnan,  1962).  In  the  hierarchy 
methods,  the  differentia!  equations  ei  averaged  before  attempting 
to  solve  them.  But  by  doing  this,  the  equation  for  the  average 
(first  moment)  involves  a  higher  moment  of  the  unknown  function.  One 
finds  that  the  equation  for  a  moment  of  any  order  involves  moments  of 
higher  order.  This  procedure  results  in  an  infinite  system  of 
equations  which  must  be  solved  simultaneously.  To  get  a  finite  set 
of  equations,  unverified  and  often  unjustified  "closure" 
approximations  are  made.  These  closure  approximations  are  the 
basis  for  what  Keller  (1964)  c»lls  "dishonest"  methods  for  solving 
stochastic  differential  equations.  The  difficulty  with  the  hierarchy 
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method  is  essentially  that  the  average  of  the  solution  of  a 
differential  equation  with  stochastic  coefficients  is  not  necessarily 
the  same  as  the  solution  of  the  averaged  equation.  Various  closure 
approximations  simply  hide  this  difficulty.  It  has  been  shown  by 
Adomian  (1967,  1968)  that  hierarchy  methods  are  valid  only  under 
special  cases,  such  as  small  randomness.  Even  then  it  is  often 
preferable  to  use  approximate  methods  whose  validity  can  be  verified 
and  wherein  errors  can  be  evaluated. 

An  important  application  of  stochastic  differential  equation 
theory  is  the  study  of  wave  propagation  in  randomly  turbulent  media. 
Wave  propagation  in  randcro  media  has  beep  •» t ’it? ^ eH  ty  Killer  (1364), 
Hoffman  (1964,  1959),  TVersky  (1964),  Wheelon  (1959),  Bugnolo  (1959, 
1961),  Lax  (1951),  Chernov  (i960),  Tatarski  (1961),  Hintter  (1953, 
1954),  Booker  and  Gordon  (1950)  and  Booker  (1959).  More  recent  papers 
have  been  published  in  the  special  issue  on  partial  coherence  of  IEEE 
Transactions  on  Antennas  and  Propagation  (1967).  Since  the  books  by 
Chernov  (1960)  and  Tatarsxi  (1961)  and  the  review  article  by  Wheelon 
(1959)  contain  excellent  reviews  of  the  older  literature  and  extensive 
bibliographies,  only  orief  remarks  are  needed  here.  Nearly  all 
studies  to  date  of  wave  propagation  in  random  media  have  assumed 
harmonic  time  dependence.  In  many  cases,  this  "quaslmonoehromaticity" 
assumption  is  clearly  not  valid;  in  other  cases,  it  needs  verification. 
Examples  of  the  first  case  are  wave  propagation  through  energetic 
media  and  interaction  of  electromagnetic  waves  in  excited  media. 

Also,  small  randomness  is  usually  assumed  from  the  outset,  for 
example,  in  the  derivation  of  the  wave  equation.  It  would  be 
desirable  to  have  a  method  where  one  applies  restrictive  sssu*ptions 
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as  late  In  the  problem  as  feasible,  so  that  it  becomes  clear  exactly 
where  the  restrictive  assumptions  are  needed  and  how  they  can  be 
removed,  if  required  for  a  particular  problem.  For  these  reasons, 
it  is  desirable  to  investigate  wave  propagation  in  the  stochastic 
media  from  a  more  general  point  of  view. 

The  rigorous  mathematical  background  for  the  theory  of  stochastic 
equations  has  been  reviewed  in  a  survey  paper  by  bharucha-Re id  (1964). 
He  presents  the  basic  definitions  and  theorems  from  probabilistic 
functional  analysis  that  are  used  in  the  theory  of  random  equations 
The  paper  also  reviews  different  classes  cf  random  equations  such  as 
random  algebraic  equations,  random  difference  equations,  random 
difterential  equations,  and  random  Integral  equations-  In  a  recenc 
Ph.  D.  thesis,  Anderson  (1967)  has  studied  in  great  detail  Fredholm 
integral  equations  with  stochastic  forcing  functions.  Strand  (1967) 
has  studied  existence  and  uniqueness  of  the  ordinary  stochastic 
differencial  equations.  Goldstein  (1967)  has  studied  the  sample 
function  behavior  of  the  second-order  Lto  processes.  The  operator 
theoretical  treatment  of  this  problem  leads  nonlinear  semigroups 
of  operators.  Ito  equations  are  very  special  stochastic  differential 
equations  and  are  not  considered  here. 

The  most  general  approach  to  stochastic  differential  equations 
or,  in  general,  to  stochastic  operator  equations,  has  been  taken  by 
Adomian  (1961,  1963,  1964,  1967).  He  has  developed  the  concept  of 
a  "stochastic  Green's  function".  The  integral  kernel  which  expresses 
the  desired  statistical  measures  of  the  solution  in  terms  of  the 
corresponding  statistical  measure  of  the  input  and  appropriate  statis¬ 
tical  measures  of  the  stochastic  coefficients  is  called  the  stochastic 
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Green's  function".  The  term  "statistical  measure"  is  U6ed  as  a 
general  term  for  the  quantities  that  characterize  stochastic  processes. 
Expectations,  spectral  densities,  and  correlation  functions  are  the 
statistical  measures  which  are  most  widely  used  in  physical  problems. 

In  the  view  of  the  fact  that  Green's  functions  have  been  widely  used 
in  applied  mathematics,  ma thema t ica 1  physics,  linear  system  analysis, 
and  e  lec  t  ron>o0ne  t  ic  theory,  it  can  be  expected  that  the  concept  of  a 
stochastic  Green's  function  may  provide  the  unifying  concept  for  a 
large  number  of  diverse  problems  that  are  described  by  stochastic 
differential  equations-  The  major  problem  in  solving  equations  by 
means  of  stochastic  Green's  functions,  as  is  the  case  with  the  ordinary 
Green's  functions,  is  the  problem  of  constructing  the  Green's  function. 
The  central  problem  of  this  dissertation  is  the  construction  and 
interpretation  of  stochastic  Green's  functions  for  various  problems 
that  arise  in  electrical  engineering. 

I  .4  General  Method  of  Solution  and  Specific  Statement  of  the  Problem 
The  ultimate  goal  of  the  solution  of  a  stochastic  differential 
equation  is  to  express  the  statistical  measures  of  the  dependent 
variable  in  terms  oi  the  statistical  measures  of  the  forcing  function 
and  the  stochastic  coefficients.  One  approach  to  the  problem  is  to 
determine  all  the  orders  of  the  multivariate  probability  distribution* 
of  the  dependent  variable.  This  gives  the  complete  statistical 
description  of  the  dependent  variable  and  hence  is  the  complete 
solution  of  the  problem.  This  method  is  correct  in  principle,  but 
is  too  difficult  to  be  useful  for  most  practical  problems.  In  most 
app  1  ica t  ions ,  one  is  primal  iiy  interested  m  correlation  functions, 
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spectral  densities  and  mean  values.  These  statistical  measures  can 
be  computed  from  multivariate  probability  distributions  but,  in  view 
of  the  complexity  of  the  problem,  it  is  desirable  to  seen,  expressions 
for  the  desired  statistical  measures  of  the  deDendent  variable  in 
terms  of  the  same  statistical  measures  of  the  forcing  function  and 
appropriate  statistical  measures  of  the  stochastic  coefficients. 
Another  reason  to  avoid  the  intermediate  6teps  is  that,  for  the 
calculation  of  the  multivariate  probability  distribution  function, 
one  needs  to  know  all  the  multivariate  probability  distribution 
functions  of  the  forcing  function  and  stochastic  coefficients.  This 
information  is  not  as  frequently  available  as  the  second-order 
statistics  (correlation  functions,  spectral  densities,  etc.).  One 
needs  to  resort  to  more  complicated  experiments  or  unjustified  assump¬ 
tions  to  obtain  the  higher  order  information  which  is  disregarded 
later  anyway.  Thus,  a  cleaner  method  is  one  which  eliminates  the 
intermediate  steps  of  obtaining  multivariate  probability  distributions 
Because  of  the  difficulty  ot  solving  differential  equations  with 
stochaatlc  coefficients,  it  is  desirable  to  have  a  metnod  which  takes 
advantage  of  known  solutions  of  the  corresponding  deterministic 
equation.  To  this  end,  one  would  seek  an  expression  for  the 
stochastic  Green's  function  in  terms  of  the  known  deterministic 
Green's  function  function.  With  this  as  motivation,  the  central 
problem  of  che  dissertation  can  be  rephrased  in  more  precise  terms 
as  follows;  Let  f.  be  an  order  stochastic  differential  operator 
defined  on  sou.,  domain  tcT  and  a  probability  space  (li,Z,P) 
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a  (t,u)  ~ 

V  dtV 


(1.2) 


where  a  (t,w)  are  time  «  random  functions,  teT  and  well  on 

V 

(fi.Z.P).  Let  the  operator  f  be  separable  Into  the  sum  of  a  deter¬ 
ministic  ooerator  L  and  a  random  operator  R.  In  particular,  let 
the  landon;  coefficients  be  of  the  form 


a  (t  ,w)  -  Mt)  tQ  (t,u)  , 

V  V  v 


(1.3) 


where  6  (t)  are  deterministic  functions  of  time  and  av(t,w)  are 
stochastic  processes  1  t^(t)  can  be  either  the  ensemble  average 
of  a  (i.wl  or  some  otner  convenient  function  of  time  ].  For  »xample, 
it  may  be  possible  to  choose  g  (t)  so  that  the  inversion  of  the 
deterministic  differential  operator  L  is  simplified.  It  is  aaaumed 
that  L  is  an  invertible  differential  operator,  that  i»,  the  Green'a 
iunction  G(t,r)  tor  the  differential  operator  L  is  known  or  can  be 
constructed .  One  can  associate  with  the  operator  f  a  atochaatic 
differential  equation 
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i(t,w),  tiT  and  wtG  on  (Q,I,?) 
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The  forcing  function  x(t,ia)  can  be  either  deterministic  or  random. 

For  greater  generality,  let  it  be  random.  It  is  also  assumed  that 
x(t,w)  is  statistically  independent  of  the  random  coefficients. 

The  problem  is  to  find  integral  expressions  for  the  statistical 
measures  of  y(t,w)  in  terms  of  the  same  statistical  measures  of 
x(t,u)  and  appropriate  statistical  measures  of  the  stochastic 
coefficients.  By  the  assumption  that  the  Green's  function  for  the 
deterministic  operator  L  is  known,  the  stochastic  differential 
equation  (1.4)  is  converted  to  a  Volterra  Integral  equation  with 
a  stochastic  kernel  and  a  stochastic  forcing  function.  The  integral 
equation  can  be  solved  by  a  Neumann  series  expansion  and  a  resolvent 
kernel  can  be  constructed.  The  stochastic  Green's  function  can 
be  expressed  in  terms  of  the  resolvent  kernel  of  the  stochastic 
Volterra  integral  equation.  This  method  of  solution  hts  the  following 
advantages : 

(i)  Knowledge  of  the  deterministic  Green's  function  is  used 
to  construct  the  stochastic  Green's  function. 

(ii)  An  iterative  method  of  solution  is  used.  The  previously 
computed  term  is  used  to  compute  the  next  term  and  60  on. 
Iteration  can  be  stopped  as  soon  as  the  remainder  term 
reaches  a  Krescribed  value. 

The  main  disadvantage  of  this  method  is  that  a  large  amount  of 
labor  may  be  required  for  the  calculation  of  the  resolvent  kernel; 
but,  on  tl.e  other  hand,  note  any  simplifying  assumptions  can  be  made 
at  places  where  their  effects  become  clear.  The  solution  of  the 
stochastic  integral  equation  is  simnlified  if  the  kernel  of  the 
integral  equation  Is  degenerate.  In  many  cases,  the  problem  of 
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solving  a  stochastic  differential  equation,  with  a  time  Invariant 
deterministic  part,  reduces  to  a  problem  of  solving  an  integral 
equation  with  a  degenerate  kernel. 

Chapter  11  contains  general  mathematical  background,  definitions 
and  terminology  which  will  be  used  in  subsequent  chapters.  Some 
basic  concepts  from  probability  theory  and  from  the  theory  of 
stochastic  processes  are  presented.  The  last  part  of  Chapter  II 
contains  a  number  of  definitions  and  theorems  from  probabilistic 
functional  analysis.  These  theorems  give  sufficient  conditions 
for  existence  of  a  solution  for  the  stochastic  integral  and  differential 
equations.  In  reading  this  dissertation,  one  may  go  directly  to 
Chapter  III  without  los6  of  continuity  and  refer  back  to  Chapter  II 
for  formal  definitions  and  specific  results  as  need  arises. 

The  relations  between  resolvent  kernels  of  Volterra  integral 
equations  and  stochastic  Green's  functions  are  discussed  in  Chapter  III. 
Both  the  Neumann  serie:  expansion  and  the  degenerate  kernel  method 
are  used  for  the  construction  of  the  resolvent  kernel.  In  both  cases, 
the  computation  is  simplified  if  the  state  space  formulation  is 
used.  The  use  of  the  state  space  formulation  has  the  further  advantage 
that  it  connects  modern  control  system  theory  with  this  work. 

In  Chapter  IV,  both  the  degenerate  kernel  method  and  the  Neumann 
series  expansion  are  used  to  study  propagation  of  a  scalar  wave 
function  in  a  randomly  time-  and  space-varying  medium.  The  statistical 
measures  of  interest  are  the  power  spectral  density  and  the  coherence 
tunctions  of  the  scalar  wave  function.  The  expressions  for  the 
spectral  density  will  reveal  the  spectral  spreading  caused  by  a 
randomly  time-varying  medium.  The  usual  quas imonochromatic 


assumption,  which  is  avoided  in  this  thesis,  fails  to  show  the 
spreading  of  the  power  spectrum  by  the  randomly  time-varying  medium. 

Chapter  V  summarizes  the  results  obtained  in  this  thesis  and 
discusses  possible  extensions  to  this  work. 


CHAPTER  II 


MATHEMATICAL  BACKGROUND 


2 . 1  Introduc  tion 

The  purpose  of  this  chapter  is  -9  establish  the  general 
mathematics  1  background  for  the  subsequent  chapters,  clarify 
terminology,  give  definitions,  and  to  state  useful  theorems  and 
inequalities.  Since  most  material  is  readily  avails  \e  in  standard 
books  (Cramer  and  Leadbetter,  1967;  Papoulis,  1965;  Pugachev,  1965; 
Lo&ve ,  1963;  Doob,  1953;  Sveshnikov,  1966;  and  Blanc-Lapierre  and 
Fortet,  1965)  and  review  papers,  (Moyal,  1949)  the  treatment  is 
brief  and  necessarily  incomplete.  Most  of  the  theorems  are  6tated 
without  proofs.  First,  some  of  the  fundamental  concepts  f-om  the 
probability  theory  and  from  the  theory  of  stochastic  processes  are 
presented.  Probability  spaces,  probability  distributions,  random 
variables  and  stochastic  processes  are  defined.  In  the  next  section, 
various  moments  suci  as  expected  values  (means),  correlation  functions, 
covariance  functions  and  higher  momei  ts  are  discussed.  A  number  of 
useful  inequalities  for  the  moments  of  stochastic  processes  are  also 
presented.  Then,  in  section  2.4,  various  concepts  of  stationarity 
are  defined.  The  concepts  of  strict  stationarity,  wide-sense 
stationarity,  reducibility  to  wide-sense  stationarity  are  discussed. 

The  following  section  (2.5)  deals  with  the  calc^  tochastic 

processes.  The  discussion  begins  with  the  definitions  of  various 
modes  of  convergence  of  the  stochastic  processes.  Interrelations 
between  these  modes  of  convergence  are  briefly  discussed.  Using 
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the  concept  of  convergence  in  the  quadratic  mean,  quadratic  mean 
continuity,  quadratic  mean  differentiability  and  integrability  are 
defined.  The  convergence  of  the  iterative  solutions  of  stochastic 
differential  equations  can  be  interpreted  according  to  one  of  the 
modes  of  convergence  of  the  stochastic  processes.  In  section  2.6, 
spectral  expansion  of  the  stochastic  processes  is  discussed  and  the 
power  spectrum  of  wide-sense  stationary  stochastic  processes  is 
defined.  In  the  following  section  the  power  spectrum  of  the  non¬ 
stationary  stochastic  processes  is  defined  in  terms  of  a  double 
Fourier  transform.  Section  2.8  develops  some  simple  results  which 
expreaa  the  expected  values  and  the  covariance  functions  of  stochastic 
processes  which  have  been  transformed  by  a  linear  deterministic 
operator.  It  is  also  shown  that  a  Gaussian  stochastic  process 
remains  Gaussian  under  linear  transformation. 

The  final  section  of  the  chapter  presents  some  definitions  and 
theorems  from  probabilistic  functional  analysis.  Probabilistic 
functional  analysis  provides  a  number  of  existence  theorems  for 
stochastic  Integral  and  differential  equations. 

We  use  the  following  convention.  If  a  word  is  underlined  in  a 
sentence,  that  sentence  serves  to  define  the  underlined  word.  The 
reader  may  go  directly  to  Chaf  er  III  without  loss  of  continuity 
and  refer  back  to  this  chapter  as  need  arises. 

2 . 2  Probability  Spaces,  Random  Variables  and  Stochastic  Processes 

Probability  theory  has  it6  own  terminology  which  is  directly 
related  to  its  intuitive  background  but,  as  a  branch  of  mathematics, 
its  concepts  are  expressible  in  terms  of  measure  spaces  and  measurable 
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functions.  To  establish  the  basic  concepts,  let  us  consider  a  random 
experiment  £  with  possible  outcomes  are  various 

observable  events  associated  with  the  experiment  E.  A  sure  event . 
denoted  by  0,  is  an  event  which  always  occurs  when  the  experiment  E 
is  performed.  An  lmposs ib le  event .  denoted  by  is  an  event  which 
never  occurs  as  an  outcome  of  E.  Both  the  sure  event  ft  and  the 
impossible  event  0  are  regarded  as  observable  events.  One  sure 
"event"  is  the  collection  of  all  possible  outcomes.  For  the 
processes  we  are  considering  that  is  the  only  sure  event.  Thus  we 

U6e  the  symbol  0  to  denote  the  whole  space  of  events. 

A  space  0  with  points  oo,  together  with  a  or- field  Z  of  Bets  in  Q, 

and  a  probability  measure  P(A)  defined  on  the  sets  A  of  Z  constitutes 

a  probability  space  denoted  by  (f»,X,P).  A  field  f  of  u  sets  is  called 
8  Borel  field .  or  a  g-f ield,  if  it  includes  ail  countable  (finite  or 
enumerable)  unions  and  intersections  of  its  sets-  P(A)  1b  said  to 
define  a  probab i 1 ltv  distribution  in  fl.  P(A)  is  a  function  defined 
on  all  events  or  sets  AeZ  and  it  has  the  following  properties: 


(2.1a) 

(2.1b) 

(2.1c) 


and  P(A)  is  countably  additive;  that  is: 

CD 

p  <jE,  y  -  )  p<y  • 

W 


0  <  P(A)  <  1  , 
P  (0)  -  o  . 

p  (0)  -  1  , 


(2. id) 
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for  disjoint  sets  A^  (A^ A^  -  0  for  j  4  k).  The  Drobability 

measure  defined  in  this  manner  agrees  with  the  usual  intuitive 
concepts  of  the  probability:  the  probability  of  an  impossible 
event  is  zero,  that  of  a  sure  event  is  one,  and  r( A)  is  approximately 
equal  the  relative  frequency  of  occurrence  of  the  observable  event  A 
when  the  experiment  E  is  performed  a  large  number  of  times. 

It  is  also  assumed,  for  mathematical  convenience,  that  the  cr-field 
2  is  completed  with  respect  to  the  probability  measure  P(A).  Thi6 
means  that  all  subsets  of  2  set  of  P-measure  zero  are  adjoined  to  %, 
and  the  smallest  rr-field,  including  this  extended  family  of  6ets,  is 
formed.  The  completed  cr-field  has  the  property  that  if  it  includes 
a  set  A  which  has  a  P-measure  zero,  then  it  also  includes  every  subset 
of  A  which  will  then  also  have  a  P-measure  zero.  The  extension  of 


P(A)  to  thi6  completed  cr-field  is  called  a 


>robab  i  l  itj 


measure.  This  extension  of  probability  measure  defines  probabilities 
for  the  events  which  may  not  be  strictly  observable,  but  this  extension 
gives  additional  analytical  freedom.  Namely,  a  probability  measure 


is  defined  for  events  that  are  obtained  from  the  observable  event 


by  any  set  operations. 

In  the  literature,  the  probability  theory  and  the  measure  theory 
terms  are  used  interchangeably.  The  correspondence  between  some  oi 
these  terms  is  shown  in  the  following  table. 
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TABLE  I 

RELATIONSHIPS  BETWEEN  PROBABILITY  THEORY 
AND  MEASURE  THEORY 


PROBABILITY  THEORY 


MEASURE  THEORY 


Probability  space 
Sure  event 
Impossible  event 
Event 

Elementary  event 
Probability 

Almost  sure,  almost  surely, 
a  .  s  . 

Random  variable,  r.v. 

Expectation,  statistical  average 
mean,  ensemble  average,  <  > 


Normed  measure  space 

Whole  space  fl 

Empty  set 

Measurable  set 

Point  w  belonging  to  the 
space 

P-measure,  normed  measure 
Almost  everywhere  P.a.e.P. 

Measurable  function 
Integral  / 
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At  sta.cd  In  Table  I,  a  random  variable  la  a  P-meaaurab le  function. 
Mathematically  the  definition  of  a  random  variable  la  alaiply  the 
definition  of  meaaurabillty .  A  function  X(w)  on  fl  to  R  •  (-a,  +«) 
la  aaid  to  be  measurable  if,  for  every  real  number  a,  the  aet 

(w  €  Q  :  X(u)  <  a) 

belonga  to  the  o-field  I  (cr-field,  measurable  seta,  events). 

The  measurable  function  X(w)  is  called  a  random  var table . 
Probability  distributions  are  defined  for  all  measurable  seta  or 
events.  When  needed,  X(ui)  may  be  allowed  to  become  infinite  or 
even  undetermined  on  an  <*»  set  of  P-meaaure  zero.  When  the  two 
random  variables  x(w)  and  y(w)  are  equal  with  probability  one, 
written 


P[x(w)  *  y(w)]  -  1  , 

they  are  called  equiva lent  random  variables.  Equivalent  random 
variables  differ  at  most  on  an  w  set  of  P-measure  zero. 

When  £(w)  ia  a  random  variable  the  probability  F(x)  •  P(£  <  x) 
is  a  non-decreasing  function  of  the  real  variable  x.  F(x)  la 
continuous  to  the  right,  and 


Urn  F  (x )  -  0  (2.2a) 

X  -•  -m 

lim  Fix)  - 

x  -*  ■ 


l 


(2.2b) 
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The  function  F(x)  is  called  the  d la tribution  function  (or  cumulative 

distribution  function,  d.f.)  of  the  random  variable  The  knowledge 

of  F(x)  for  all  x  determines  the  probability  P(£cA)  for  every  Borel 

set  A.  A  is  a  subset  of  the  real  line  R. 

The  random  variables  will  jointly  induce  a 

probability  in  n-d  linens  Iona  1  Euclidean  space  R°.  The  probability 

F(X]L,x  ,...xn)  -  P(;x  <  Xj.  C2<  •  •  *  '  ^  -  XnJ  i#  *  nondecreaaing 

function  in  each  variable  x.  ,  x>,...x  ,  it  is  continuous  on  the  right 

1  l  n 

in  each  variable  and 


lim  F  (x.  ,  x,,...x  ,..x  )  -  0  i  •  1,2, ...n,  (2.3a) 

12  in 

v  — *  -ao 

i 


and 


1  im 


x  ^  >  X2  ’ 


F(x1(*0 , 


•  x  )  -  1 
n 


(2.3b) 


F (x, ,x, , . . .x  )  is  the  multivariate  dlstr lbutlcn  fupc tlon  (joint 

12  n 

distribution  function,  J.d.f.)  of  the  random  variables  Cj » *  •  '  • 

Its  knowledge  determine*  the  probability  assigned  to  every  Borel 

set  of  R*1  by  the  n-d imena Iona  1  distribution  of  the  £  .  The  randoai 

variables  C,,  can  be  thought  of  as  component*  of  an 

1  i  n 

n-d imens ions  1  random  vec tor 

s  '’l'"  V 

The  distributiun  function  of  the  random  v*ctor  £  is  identical  with 


the  multivariate  distribution  of  ita  compon-nt* . 
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Mow  we  turn  to  a  generalization  of  the  preceding  concents  of 
random  variables  and  their  distribution  functions.  That  is,  we  shall 
consider  an  arbitrary  family  (X(t,i*>))  of  random  variables  where  t 
runs  through  some  index  set  T.  If  T  consists  of  a  single  point  we 
have  a  single  random  variable;  a  finite  T-set  corresponds  to  the 
finite  family  of  random  variables.  When  T  is  an  interval  of  real 
nuaribers,  the  family  (X(t,w):t€T]  is  called  a  continuous -parameter 
stochastic  process  or  a  random  function.  Physical  systems  subject 
to  random  influences  can  be  described  by  stochastic  processes. 

Another  way  of  looking  at  stochastic  processes  is  the  following. 

A  random  variable  X  is  a  set  function  on  the  sample  space  0;  that 
is,  a  random  variable  X  assigns  a  number  X(w)  to  every  weft.  In  the 
case  of  u  stochastic  process,  for  every  t*»eQ,  n  function  X(t,v)  is 
assigned.  Hence,  we  are  dealing  with  an  enseabie  or  a  family  of 
functions.  X(t,ui)  is  often  a  function  of  tis*,  but  it  may  very 
well  be  a  function  of  any  other  quantity  such  as  position.  With  the 
preceding  discussion  as  motivation,  a  rigorous  definition  of  a 
atochaat'c  process  la  now  given.  Let  a  probability  space  (fl,I,P) 
and  a  parameter  set  T  be  given.  A  g toe  ha  a  t lc  process  i»  a  finite 
real  valued  function  X(t,w)  which,  for  every  fixed  tcT,  ia  a 
measurable  function  of  well.  A  itochaatic  vector  process  is  en 
n-d lmens ions  1  vector  whose  components  are  stochastic  process;  that 
ia: 

“  {X. (t,w),  X  (t,w)  ---  X  (t.w)} 

i  i  n 


X(t,w) 
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A  particular  vector  process,  with  n  -  2,  is  a  comp  lex- va lued  stochastic 
process  X(t,uj)  +  i  Y(t,u).  There  are  several  way6  to  interpret 
stochastic  processes.  Stochastic  processes  can  be  considered  as  a 
collection,  or  an  ensemb  le  or  a  family  of  functions.  Each  particular 
function  in  the  collection  is  called  a  sa mp le  f unc t ion .  a  rea 1 ita t ion 
of  a  stochastic  process,  or  a  representative  function.  If  t  ia  fixed 
at  any  particular  Cq,  then  X(to,u)  is  simply  a  random  variable.  On 
the  other  hand,  if  w  is  fixed,  then  X(tw^)  is  simply  a  sample  function 
of  t-  If  both  u;  and  t  are  fixed  we  have  a  single  number.  The 
stochastic  process  can  be  very  complicated  or  quite  simple.  An 
example  of  a  complicated  process  is  Brownian  motion.  The  sample 
functions  are  the  coordinates  c  a  particular  particle  which  is  in 
irregular  motion  iri  a  liquid  or  gas.  The  irregular  motion  of  the 
particle  if  caused  by  the  random  impacts  with  the  particles  in  the 
surrounding  medium.  It  the  particle  has  negligible  bonds  with  the 
medium  except  ac  times  ot  impact,  almost  all  Brownian  movement 
sample  functions  ate  ot  unbounded  variation!  (Doob ,  1953,  p  j^5). 

An  example  of  a  simple  process  is  the  output  of  a  signal  generator 

XU.«>)  “  <M>)  cos  < 2 ft t  (w) t  +  ,  (2.4) 

where  a  (w)  :s  the  random  amp!  •  tude ,  » («.*)  is  the  random  frequency  and 
is  Che  random  phase.  Tin;,  is  ntecirely  what  is  expected  tr  a 


usual  experimental  si 

ua  t  :  \>n  : 

t  hr  ,i  tr.:>  1  i 

tude,  liequencv  a  no  ihase 

of 

the  signal  generator 

a  tv  only 

Known  wit 

ill! 

r  tie  limits  of  t he 

me as ur omen t  i c c u  ra c  v  . 

xu*-) 

.»s  given 

by 

12  -s  )  i  s  a  stcc  hast  ie 

process 

but  its  sample  functi 

ons*  hav«* 

Vt’  I  V  Mill) 

le 

analytic  properties. 

From 

the  nathe.ivitic.il  point  >>I  view,  a  stochastic  ptoc-ss  is  a  function 
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X(t,u>)  of  two  variables  t  and  uj.  The  domains  of  definition  of  t  and  u> 
are  the  sets  T  and  3. 

For  t  fixed  at  t^,  we  have  a  random  variable  X(t^,w)  with  a  first- 
order  distribution  function  for  the  stochastic  X(t,w)  given  by 

-  P{X(trw)<x]  .  (2.5) 

For  an  arbitrary  finite  set  of  values  of  t,  t, ,  t_  —  t  ,  we 

I  i  n 

have  the  corresponding  random  variables  X(t^,w),  X(t2»w)  —  X(tn>u)) 
with  the  n-dimensiona  1  Joint  (distribution  function 

F(x1,x2,---5xn;t1,t2>---,tn)  “  P  -  »1»--".X(tn,uj)  <  xn)  . 

(2.6) 

Clearly  a  stocha  tic  process  is  completely  specified  if  the  distribu¬ 
tion  functions  are  known  for  all  n  •  In  many  physical  problems, 
such  a  complete  knowledge  is  not  available  and  one  must  be  satisfied 
with  a  knowledge  of  "ay  its  second-order  statistics  (s  ati6tics 
calculated  from  the  second-order  distribution  functions,  for  example, 
correlations,  power  spectrum).  Second  order  properties  are  discussed 
in  the  next  section. 

If  *he  distribution  functions  are  differentiable,  the  probability 
density  functions  exist  and  are  given,  for  the  first-order  distribution 
function  by 


f(x,t) 


dF(x, t) 


(2.7a) 


27 


and  for  the  n-d imens iona 1  joint  distribution  function,  by 


f(x  x  ---  x  t  -  ---rl  m  12  »  1  2  n 

12  n  1  2  n  &c,  dx,  — - 

Li  n 


(2.7b) 


2 . 3  Moments  of  Stochastic  Processes 

As  was  stated  before,  a  stochastic  process  is  completely  specified 
if  its  distribution  functions  are  known  for  all  finite  n  .  In  many 
physical  problems,  such  complete  knowledge  is  not  available  or  it  is 
excessively  complicated  or  costly  to  measure  these  distribution  functions 
experimentally.  An  alternative  spec  i*.  ..ca .  ..  to  use  vt  ious  moments 
(defined  below)  of  the  stochastic  process.  The  first  two  momr  ts  have 
found  wide  use  in  the  communication  and  control  system  theory.  The 
expected  value  (ensemble  average,  mathematical  expectation,  statistical 
average),  of  any  function  g(x,t)  of  a  stochastic  process  is  given  by 


r 

<  g(x(w),t)  >  -  J  g(x,t)  d  F(x,t) 


(2.3) 


In  this  dissertation,  the  symbol  <  g(x,t)  >  is  used  to  denote  the 
ensemble  averaging.  Equation  (2.8)  is  a  Riemann-Stieltjes  integral. 
If  the  probability  density  function,  f(x,t)  of  x(t,w)  exists,  the 
expected  value  is  given  by 


<  g(x(w),t)  > 


g(x,t)  f (x , t )  dx  ,  (2.9) 
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where  (2.9)  is  the  usual  Riemano  integral.  The  particular  expected 

value  of  x,  <  x(t ,w)  >  »  px(t),  is  the  mean  or  first  moment .  and 
2  2 

<  (x(t,w)  -  p(t))  >  *  a  (t)  the  variance  of  the  stochastic  process. 

The  function  <  x(t,w)n  >  is  the  n-th  moment  of  x(t,w)  and  <  (x(t,w)  - 
U(t))°>  is  the  n-th  central  moment  of  x(t,u). 

If  X(t,u>)  and  Y(t,u)  are  independent  stochastic  processes,  then, 
by  definition  of  independence, 

F(x.y;t1,t2)  »  FCxjtp  F (y ; t j )  U-10) 

and 

09  00 

<  XCt^jw)  Y(tj  ;w)  >-  J  J  gCxjtj,)  h  <y ;  t2 )  dF(x,y;tlSt2) 


i  W 

I'  «<x ; tL>  h(y;t2)  dFfc;^)  dF(y;t2> 


J  gfr;^)  dF(x;t1)  J  h  (y ;  c2 )  dF(y;tj) 


<  X(t1,u)  >  <  Y(t2,w)  >  . 


(2.11) 


The  above  property  of  the  expectation  operator  will  be  used  frequently 

to  separate  the  ensemble  averages  of  statistically  independent 

stochastic  processes.  If  either  <  X(t^,w)  >  or  <  Y(t2;w)  >  i*  tero 

and  X(c. ,w)  and  Y(t, ,w)  are  statistically  independent,  then  obviously 
1  2 


29 


<  X(tL,u)  Y(t2,u)  >  ■  <  X(t1(u)  >  <  Y(t2,u)  >  ■  0  .  (2.12) 

The  stochastic  processes  X(t,w)  and  Y(t,w)  are  said  to  be  uncorrelated 
if 

<  X(t,w)  Y(t,w)  >  *  <  X(t,u))  >  <  Y(t,w)  > 

Statistical  independence  implies  that  random  processes  are  uncorrelated, 
but  not  vice  versa.  If 


<  X  (t,u>)  Y(t,u>)  >  «  0  ,  (2.13) 

the  stochastic  processes  are  said  to  be  or thoaona 1 .  Orthogonality  is 
used  frequently  to  simplify  expressions  involving  stochastic  processes. 

The  most  widely  used  moments  are  the  first  and  second  moments,  the 
mean  and  correlation  functions,  respectively.  The  theory  based  on  the 
first  two  moments  i6  called  the  second-order  theory  or  the  correlation 
theory.  This  dissertation  deals  principally  with  the  second-order 
theory  of  stochastic  differential  equations.  Unless  ^uierwise  stated, 
it  is  assumed  that  second  moments  of  the  stochastic  processes  exist. 

For  a  complex  process,  the  autocorrelation  function  is  defined  by 

Rxx(t1,t2)  -  <  X(t1,u)  X+(t2,uj)  >  ,  (2.14) 

* 

where  denotes  the  complex  conjugate.  The  autocovariance  is  defined 

by 

CXX(tl,t2)  "  <  -  M(tL)]  [X(t2,u>)  -  p(tj) ]*  > 

-  R(t1,t2)  -  p(tL)  p*(t2)  , 
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where  ^(t^  »  <  X^^w)  >  and 

/(t2)  -  <  X*(t2,u0  >  .  (2.15) 

When  the  means  p(t^)  *  p(t2)  “  0,  Che  autocorrelation  and  the  auto¬ 
covariance  are  equal.  Often,  it  is  convenient  to  work  with  tero  mean 
processes  for  this  reason.  In  such  case6,  the  terms  correlation  and 
covariance  can  be  used  interchangeably. 

The  cross- correlation  of  two  stochastic  processes  is  defined  by 

R^a^tj)  -  <  X(t1,w)  Y*(t2,u)  >  ,  (2.16) 

and  their  croes-covariance  by 

CXY(tl,t2)  "  RXY(tl,t2)  ‘  MX^tl^  4Y(t2)  '  (2'17) 

A  numoer  of  useful  inequalities  can  be  derived  by  considering: 

tX(t1,w)  +  k  Y  ( 1 2  i«)  ]  [X(tru)  +  k  Y(t2,u))]* 

-  ^(tj.tj)  +  k  [Rxy(ti,t2)  +  RYX(t2 » ci^  1  +  k2  RYY(t2,t2)  -  0  * 

(2.18) 

The  above  quadratid  in  k  is  nonnegative  for  every  k;  hence  k  must 
have  no  real  roots.  This  means  that  the  discriminant  of  the  quadratic 
in  k  must  be  nonpoaitive.  Therefore,  we  have  the  following  inequality; 


31 


2  , 


^RXY(tl,t2)  +  RYX^C2,tl^  -  4  *YY^t2,t2^ 


[f  X(t,w)  and  Y(t,u>)  are  real  processes,  (2.19)  simplifies  to: 


(2.19) 


Rxy  (tl,t:2J  -  Rxx<'tl,tl)  RYY(t2,t2) 


(2.20) 


If  X(t,w)  «•  Y(t,u>)  then  we  have  a  special  case  of  (2.20) 


RXX  (tl,t:2^  -  RXX*tl,tl*  RXX(C2't2^ 


(2.21) 


The  normalized  correla tion  coeff 1c ienL  is  defined  by 


pxx(trc2) 


RXX(tl,t2) 


fRXx(trtl)  RXX(t2,t2^ 


Y  ,  (2*22) 


and  S.FS  ^'correlation  coefficient  by 


___^xy5vV _ 

<Vv  "  k 

l'RXx(Cl,tl)  RYY(t2,t2)^ 


From  (2.21)  and  (2.20)  we  have 


°<  I  Pyx  I  <  1 


o<  IpxYI  <  i 


(2.23) 


(2.24) 

(2.25) 


i 
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The  second  order  statistics  of  an  n  dimensional  stochastic  vector 

•re  given  by  a  covariance  (or  correlation)  matrix.  The  covariance 

matrix  of  an  n  dimensional  stochastic  vector  X(t,w)  ■ 

[X^(t,u>),  X2(t,w)  ---  Xn(c,w)]  is  a  n  x  n  matrix  with  the  elements 

C  (t.,t»).  If  all  the  elements  of  a  stochastic  vector  have 
Xi  *J 

zero  mean,  the  covariance  matrix  can  be  obtained  by  computing 
<X(t^;w)  X^tj.w)  >,  where  X(t^;w)  is  an  n  dimensional  column  vector 
and  ^denotes  the  complex  conjugate  transpose  (hermetian  conjugate). 

In  section  3.6,  the  solution  of  a  control  system  problem  with  a 
stochastic  state  transition  matrix  is  expressed  in  terms  of  the 
covariance  matrix  of  the  6tate  variables.  The  terms  "state  transition 
sMtrix"  and  "state  variables"  are  defined  in  section  3.6. 

Another  term  used  for  the  correlation  or  covariance  functions 
(both  terms  may  be  used  interchangeably  since  we  are  talking  about 
zero  mean  stochastic  processes)  in  partial  coherence  theory  is  the 
mutual  coherence  function.  The  mutua 1  coherence  function  is  simply 
the  following  ensemble  average; 


s 


Y  ^1**2* 
12 


;prp2)  - 


Wpi*w) 


(t2,p2,w) 


(2.26) 


where  Y^(t^,P^,u>)  and  are  complex  field  disturbances  at 

two  points  and  The  mutual  coherence  function  defined  in  this 

manner  is  the  ensemble  coherence  function.  If  time  averaging  is  used, 
one  has  a  time  coherence  function.  Both  the  ensemble  coherence 
functions  and  time  coherence  functions  have  been  used  in  statistical 
'ntics  and  in  general  stochastic  electromagnetic  theory.  The  ensemble 
coherence  functions  are  discussed  further  in  Chapter  IV. 
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A  number  of  basic  inequalities  and  properties  can  be  established 
for  stochastic  processes.  Some  of  th'*  more  useful  ones  are  stated 
without  proofs.  Proofs  and  more  complete  discussion  is  found  in 
Lo&ve,  (1963,  page  156). 

1 .  If  for  some  m>0,  <  |X(t,w)jm  >  <  «,  then  <  |X(t  ,(*>)  |  > 

is  finite  for  n  <  m,  and  <  X  (t,w)  >  exists  and  is  finite 
for  k  <  m. 

2 .  Holder  inequa lity 

For  any  two  processes  X  and  Y  or  the  finite  moments, 

I  l  l  i 

<  )XY |  >  <  <  |x|m  >m  <  | Y [ n  >n ,  where  m  >  1  and  “  +  ~  ■  1. 

(2.27) 

3.  A  spec  ia  1  case  of  the  Holder  inequality  is  the  Schwarz 
inequa lity  ^|XY|>^<  <  |  X  j  ^  >  <  |  Y  j  >. 

(2.28) 

4 .  Minkowski  inequa lity 
Under  the  same  hypothesis  as  2, 

I  I  i 

<  |X  +  Y  | "  x  <  |xi1’  >"  +  <  |  Y  | P  >" 

JL 

5.  If  <  |  X  | 11  >  exists  for  each  n,  then  <  jx| 


(2.29) 


is  a  nondecreasing  function  of  n. 
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2  .4  Statlonarltv  Concepts 

In  some  applications,  the  statistical  properties  of  stochastic 
processes  exhibit  some  invariance  under  translation  of  tine,  space  or 
some  other  independent  variable-  As  more  or  less  stringent  conditions 
of  invariance  of  the  statistics  are  imposed,  different  types  of 
•tationarity  may  be  defined.  A  stochastic  process  X(t,w)  is  said  to 
be  strictly  stationary  (stationary,  stationary  in  the  strict  sense, 
statistically  homogeneous)  if  the  whole  family  of  its  finite-dimensional 
distributions  are  invariant  under  a  translation  in  the  parameter  t; 
i.e . , 

F(x1,x2,...xni  t1,t2, . .  .tn)  “  F(x1,x2,...xn;  +  h,  t2  +  h,.  .tR  +  h) 

(2.30) 

for  any  n,  t^ ,  t2  , .  .  . ,  t  ,  and  h.  The  statistics  of  the  strictly 
stationary  stochastic  processes  are  not  affected  by  the  choice  of 
time  origin.  The  processes  X(t,u)  and  Y(t,ui)  are  jointly  sta  t  ionary 
(in  the  strict  sense)  if  the  joint  distributions  are  invariant  under 
a  translation  in  the  parameter  t.  A  complex  process 

Z(t,u))  -  X(t,ui  +  i  Y(c.u) 

la  said  to  be  stationary  if  X(t,ui)  and  Y(t,u>)  are  Jointly  stationary. 

A  process  X(t,w)  is  gtat  lonary  of  order  k  it  (2.30)  is  true  only  for 
n  <  k.  A  process  which  is  stationary  ol  order  2  is  also  a  vtde-sense 
stationary  (weakly  stationary)  process.  A  stochastic  process  is  a 
wlde-sense  6  ta  t  lonary  process  it 

X(t,uj)  >  »  y  ■  constant, 


3j 


and 


<  X^jw)  X  (t2 ; w)  > 


<  X(tL;uj)  X  (tL  +  t;  w)  >  -  1^(0 


(2.32) 


The  wide-sense  stationari:y  involves  only  the  first  two  moments.  For 
this  reason,  in  a  second-order  theory  only  the  weaker  assumption  of 
wide-sense  stationarity  is  used  instead  of  the  stronger  assumption  of 
strict  stationarity.  Two  processes  are  jointly  stationary  in  the 
wide  sense  if  each  is  stationary  in  the  wide  sense  and  their  cross- 
correlation  depends  only  on  t2  -  t^: 


VT) 


<  X(tjiu)  Y  <tx  +  t;  u)  > 


(2-33) 


One  often  meets  stochastic  processes  which  can  be  expressed 
comparatively  simply  in  terms  of  wide-sense  stationary  stochastic 
processes.  Such  stochastic  processes  are  68  id  to  be  reduc ib  le  to 
wide-sense  stationary  processes.  Ar  example  of  auch  a  process  is 


Y(t.ui)  -  t  (t)  X(t,->)  +  g(t). 


(2.34) 


where  X(t,w)  is  a  wide-sense  «tationarv  stochastic  proceas,  f(t)  and 
g(t)  are  real  functions.  The  mean  of  Y(t,u>)  is 


u^(t)  -  t(t)  ux  +  g(t), 


(2  35) 


die  covariance  of  Y(t,uj)  is 
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CYY(tl,t2) 


-<  (^f  (ti)X(t1,w)+g(t1)-f  (tl  L  )y  i  f(t2)X(t2,w)+g(t2)-f(t2)ux-g(t2)  J  > 


f (C I >  RXX^W  K 


f(C1)  f(t2)  Cxx(t2*t1), 


(2.36) 


and  the  variance  of  Y(t,w)  is 


-  f2(t)  CyJ((0) 


(2.3?) 


The  normalized  covariance  function  of  Y(t,uj)  is 


CYY(CL,C2) 


i(tj)  f(t2)  cxx ( c  2 - 1 L ) 

— r - - - - r -  -  c  ( t  -  t  ) , 

[i‘(tL)  t‘(c2)  (0)  1*  XX 

(2-38) 


which  it  the  saine  as  the  normalized  lOv.ir  lunci  tuncticu  ot  the  wide- 
sente  stationary  process  X(t.^) 

The  important  concepts  ot  lick’  averages,  time  autocorrelation 
functions  and  egodicitv  ate  not  discussed  here  because,  in  this 
d  itterta  t  ion ,  ensemble  statistics  ,ue  used  ox  lusivelv. 

2 • 5  Calcuiug  of  Stochastic  Processes 

In  order  to  stud',  the  a  i,.i  l  .  t  ic  a  !  pronirties  ot  stochastic- 
processes,  the  concent  of  convet  >;eiu  e  must  no  net  ned  tirst.  Suppote 
a  sequence  of  tandon  vaiiables  *  (.•.■)  ,  *,(..) .  is  given  and  all 
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the  random  variables  x  (w)  are  defined  on  the  same  probability  space 

n 

fi .  Let  x(u>)  be  another  random  variable  defined  on  the  same  probability 
space.  One  could  define  convergence  in  the  same  manner  as  it  is 
defined  in  deterministic  analysis,  requiring  that  the  sequence  xp 
converges  to  x(w)  for  every  realization  of  the  sequence.  Such  a 
definition  of  convergence  is  too  restric  ive .  In  stochastic  theory, 
it  is  convenient  to  allow  less  string  nt  modes  of  convergence.  Three 

most  important  modes  of  convergence  of  x^  (u>)  to  the  limit  s(w)  at 

•k 

n  °°  are: 

1)  xn  (w)  converges  to  x(ui)  almost  everywhere  P-measure  (a.e.P), 

or  vita  probability  one,  or  almost  sure  (a.s.),  if 

P(x  (iv)  -*  x  (w) )  «■  1 . 

r, 

2)  x^(<v)  converges  to  x(w)  in  quadratic  mean  qq.ra.),  or  in  mean 
square  (m.6.)  or  limit  in  the  mean  (l.i.rn .),  if 

<  J  (uj)  -  x  (tv)  P  >  -*  0 

3)  x  (tv)  converges  to  x(v)  in  probability,  or  in  P-measure,  it, 

tot  everv  c  -  0 ,  P (  !x  (~)  -  x  (tv)  t  >  f  )  -»0. 

'  n 

In  addition  to  these  titter  .i  tourth  ^e.e ,  is  sometimes  used. 

h)  x  (w)  converges  to  x (v)  in  distribution  tunct  or,  it  ar  every 
point  o  i  continuity  ol  K(,x),  F(x  )  -*  F  (x )  . 

The  first  three  modes  ol  convergence  are  analogous  to  the  correspond ing 
mode*  ot  convergence  in  measure  theory-  Otic  can  show  that  »  Uou 
everywhere  (*e  ?.)  and  quadratic  mean  (q.m.)  convergence  imply 

* 

Ctatner  and  Lendl  i  tti  i  ,  I3b7 


i 

i 


convergence  in  probability  and  convergence  in  probability  implies 
convergence  in  distribution  function  (Papoulis,  1965).  The  relations 
between  tht  e  four  modes  of  convergence  are  shown  in  Figure  2.1.  In 
this  dissertation,  almost  everywhere  and  quadratic  mean  convergence 
are  used  most  otten.  Using  the  definition  of  quadratic  mean  conver¬ 
gence,  quadratic  mean  continuity  and  quadratic  mean  differentiation 
can  be  defined.  A  second  order  stochastic  process  is  continuous  in 
quadratic  mean  at  teT  if  X(t  +  h;w)  converges  to  X(t,<J)  in  q.m.  as 

h  -♦  0,  t  -f  hcT.  A  second-order  stochastic  process  X(t,w)  on  T  has  a 

dX ( t . w'j 

derivative  in  quadratic  mean  — —  ,  at  teT  if 


£  xL„t  Jh 

h 


jX(tL.vl 

d  t 


as  h  ~*0,(t  +  h)eT- 


(2.39) 


By  using  almost  everywhere  convergence  instead  of  quadratic  mean 
convergence,  almost  everywhere  continuity  and  differentiability  con 
be  defined.  Higher  order  derivatives  and  partial  derivatives  in 
quadratic  mean  can  be  defined  similarly  to  (2.39).  The  quadratic  mean 
Riemar.n,  Riemann  Stieltjes  and  Lebesgue  integrals  can  be  defined  by 
using  the  quadratic  mean  convergence  of  the  approximating  6ums  which 
are  used  in  the  definitions  of  these  integrals.  The  ordinary  formal 
properties,  such  as  additivity  and  integration  by  parts,  hold  for 
integrals  in  quadratic  mean  under  the  appropriate  conditions  (LoVve, 
1963).  The  following  theorem,  which  is  stated  and  proved  by  Lo'eve 


<■1963),  will  be  later  used  to  find  expectations  of  iterated  integrals. 


NO  CONVERGENCE 


Figure  2 .  i 


Comparison  of  Various  Modes  of  Convergence 
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Theorem  I.  Let  the  second  order  stochastic  processes  X(t,w)  [with 
covariance  function  C  (t,t')]  be  independent  of  the  second-order 
increment  function  AY(t*  ,w)  (with  covariance  func tion  Q^(t , t 1  ) 
on  an  interval  I  X  I,  where  I  "  f a , b ]  is  a  finite  or  infinite  interval). 
Then, 


j  X(t,w)  dY(t,w)  exists  if,  and  only  if, 
I 


J  J  ')  ( t ,  t 1  )  exists;  also,  if  the  integral 

I  I 


in  quadratic  mean  which  appear  below  exist,  then 


f  X(t,w)  dY(t,w)  j  X*  (t* ,w)  dY*  (t' ,w) 


-  /  f  <  X(t,ui)  X*  (t'.w)  >  dd'  C  (C ,  t  ’ ) 

u  \j  y  y 

i  i* 


(2.40) 


The  double  integrals  are  the  usual  Riemann-Stielt jes  integrals. 

The  independence  condition  of  this  theorem  is  fulfilled  when  the 
stochastic  process  X(t,w)  and  Y(t,w)  are  independent  or  when  either 
X(t,w)  or  AY(t,u)  degenerate  into  deterministic  functions.  The 
independence  condition  can  be  suppressed  altogether  when  the  elements 
of  the  double  integrals  are  replaced  by  dd  <  X(t,w)  X  (t',u))  Y(t,u>) 
Y*(t’,w)  >  . 
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The  convergence  of  che  iterative  solutions  of  stochastic 
differential  equations  can  be  interpreted  according  to  one  of  the 
modes  or  convergence.  Probabilistic  functional  analysis,  as  dis¬ 
cussed  in  section  2.9,  uses  the  almost  everywhere  P  convergence 
(almost  sure  convergence).  The  convergence  in  quadratic  mean  (mean 
square  convergence)  also  has  found  wide  use  in  applications  such  as 
communication  and  control  system  theory. 

2 , 6  Expansions  of  Stochastic  Processes  and  Spectral  Theory 
Analytical  operations  with  stochastic  processes  can  be 
simplified  if  they  can  be  represented  as  linear  combinations  of 
orthogonal  random  variables.  A  stochastic  process  x(t,w)  can 
frequently  be  expressed  either  as  an  infinite  series 

CD 

X(t,u>)  .  px(t)  +  _  Xk(w)  gR(t)  ,  (2.41) 

k-l 

or  as  an  integral 

00 

r 

x(t,w)  ■  |i  (t)  +  X(s,u>)  g(t,s)  ds  . 

X 

(2.42) 

In  (2.41)  X  (w)  are  orthogonal  random  variables  and  g  (t)  are  deter- 

K  K 

ministic  functions.  In  (2.42)  X(s,w)  is  a  random  function  of  the 
parameter  s,  g(t,s)  is  a  deterministic  function  of  time  and  6.  The 
random  variables  X^(w)  satisfy  the  following  orthogonality  condition: 

<  X.(w)  X.  (w)  ->  *  0  for  i  4  J 

•  g . “  for  i  -  j . 


f 


(2.43) 


-  t*r* 


The  corresponding  orthogonality  condition  for  the  integral  expansion 
(2.42),  written  as  the  following  Riemann-Stieltjea  integral, 


x(t,w)  »  u  (t)  +  f  g(t,s)  d  X(s ,u) , 
X  J  B 


(2.44a) 


<  d  X(s,w)  >  -  0 

s 


(2.44b) 


<  d  X(s.;<a)  d  X  (s,;w)  >  -  ®  (s  )  5(s,  -  s,)  ds  ds  . 

S  j  1  s0  l  XX  i  l  l  1  / 


(2.44c) 


The  expansions  (2.41)  and  (2.42)  have  been  called  in  the  literature  by 
a  number  of  different  names.  They  are  known  as  the  canonical  expansions 
(Pugachev,  1965),  orthogonal  decompositions  (Loeve,  1963)  or  as  the 
Karhunen-Loeve  expansion.  In  Chapter  TV,  the  integral  expansion  (2.42) 
is  used  to  study  a  wave  propagation  problem  in  a  randomly  time-  and 
space-vary ing  medium.  The  dielectric  permittivity  is  assumed  to  b® 
a  wide-sense  stationary  stochastic  process.  For  this  reason,  the 
following  discussion  is  restricted  to  the  integral  expansion.  For 
simplicity,  it  Is  assumed  that  p^(t)  ■  0.  For  the  wide-sense 
stationary  zero  mean  process,  the  integral  expansion  (2.42)  is 
(Pugachev,  1965,  p.  239): 


X(s,tj)  ei6t  ds  , 


(2.45a) 


x(t ,w) 


-00 
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where  X(s,w)  is  given  by 


X(s,u)  * 


1 

2« 


r 


j 


,  \  “1st  . 

x(t,w)  e  dt 


(2.45b) 


The  integral  expansion  (2.45a)  is  also  known  as  the  spectral 
representation  of  the  wide-sense  stationary  stochastic  processes, 
and  (2.45a)  should  be  written  as  a  Riemann-Stieltjes  integral 


1st 

x(t,co)  -  j  e  dg  X(s,w); 


(2.46) 


however  it  is  more  convenient  to  operate  with  the  integral  expansion  as 
it  is  expressed  by  (2.45a).  In  such  case,  it  must  be  kept  in  mind 
that  X(s,u))  may  be  a  generalized  function.  If  X(s,w)  is  given  by 
(2.45b),  then  we  have,  for  the  wide-sense  stationary  processes. 


<  X(s1,u))  X  (s2,w)  > 


/  i  ?  If'  *  isltl  i62t2 

—  y  J  J  <  x(tl(w)  x  (t2;u>)  >  e  e  dtj  dt2 


i  r  I  ,  "“lb  Ie2c2 

T,  J  I  J  \*(t2  •  h1  e  '  “l  dt2 


(2.47) 


Making  the  change  of  variable  t.,  -  t,  ■  t,  (2.47)  becomes 

£  1 


<  X(s  L  ,u>)  X  (s2,ui)  > 


(  j  !  !  K  (t)  e  1  1  e  2  dr  dt, 


XX 


“8,t,  ifi^T 

C 


(2.48) 
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BUt; 


jl  r  1 

2*  J  * 


it,  <*2  ‘ 


dtL  -  6(s2  -  a^  . 


(2.49) 


Hence 


<  X^ju)  X*(s2;u)  >■  6(a2  -  8^  J  Rxx(t)  e  2  dT 


-  £(s2  -  8l> 


-*V 

R  (t)  e  dt  . 
xx 


(2.50) 


This  relation  (2.50)  will  be  used  often  in  Chapter  IV.  The  power 
anectra  1  denaltv  ♦Jtx(*)  (p«*er  spectrum)  of  a  wide-sense  stationary 
stochastic  process  is,  by  definition, 


«  (a) 

xx 


~k  J  R,x(T>  dT 


(2.51) 


The  spectral  density  and  the  correlation  functions  are  Fourier  trans¬ 
form  pairs  of  one  another, i.e. ; 


R  (t)  -  f  ♦  (s)  ei8T  ds 

xx '  J  xx 


(2.52) 


There  is  no  universal  agreement  whether  the  factor  1/2  a  is  placed 
in  front  of  (2.51)  or  in  front  of  (2.52).  The  variance  of  the 
stochastic  process  X(t,w)  can  be  found  from  the  power  spectral 
denaity  by: 

m 

2 


R  (0)  -  o 

xx 


»  (s)  ds 

XX 


-no 


(2.53) 
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Frcm  the  assumption  that  X(t,u>)  is  a  second  order  process,  that  is 
2 

o  is  finite,  we  have: 


fl>  (s)  ds  <  »  , 

XX 


(2.54) 


For  real  stocl  ssti^  processes,  R  (r)  is  an  even  function  of  r,  and 
it  cen  be  easily  shown  by  making  a  change  of  variable  r  •  -t^  in 
(2.51)  that 


$  (s)  “  ♦  (-s) 

XX  XX 


(2.55) 


The  spectral  function  is  defined  by: 


S  (s'- 
xx  1 


$  (s)  ds 

XX 


(2.56) 


It  can  be  shown  that  S  (s,)  is  a  real  nondecreasing  bounded  function 

xx  1 

of  its  argument  s^  (Khintchine,  1934).  From  this  property  it  fc.’ows 
tha  t 

♦  (s)  >  0  .  (2.57) 

xx  _ 

The  mutual,  spectra  1  density  of  Jointly  wide-senre  stationary  second 
order  stochastic  processes  X(t,w)  and  Y(t,w)  is  given  by 

«e 

*  (s)  •  — r~  [  R  (r)  e  i8T  dT  .  (2.58) 

xy  2«  J  xy 


j 

f 


) 


) 


■Ifi- 


In  this  section  the  discussion  of  the  power  spectrum  was  limited 
to  the  vide-sense  stationary  processes.  In  the  next  section,  the 
definition  of  the  power  spectral  density  is  generalized  to  be  appli¬ 
cable  to  the  nonstationary  processes.  This  generalization  la  needed 
for  the  discussion  of  nonstationary  solutions  cf  the  scalar  wave 
equation. 

2 . 7  Spectrum  of  Nonstationerv  Processes 

When  the  stochastic  orocess  X(t,u))  is  not  wide-sense  stationary, 

its  autocorrelation  function  is  X  (t,  that  is,  the  autocorrela- 

xx  1  2 

tion  function  is  a  function  of  t^  ind  rather  than  just  t2  *  t^. 

For  this  reason  the  power  spectral  ..  .is  ty  for  a  nonstatienary  process 

is  given  by  the  double  Fourier  transfor  i  of  R  (t,,t,): 

J  xx  1  2 


®vv  *  2  1 

**  1  (2n)  J 


with  the  inversion  formula 


RXX(tl,t2>  e 


+18^,  -is2t? 


dt,  dt,,, 


(2 .  ‘  ') 


R (f  ^  *  tj  ) 


-is1t1  +  is2t2 

*XX<,1’,2>  *  d,l  d*2  ■ 


(2  60) 


From  the  fact  that  ^(t^.tj)  “  8nd 


♦xx(si>«2)  "  *XX  (s2,el) 


Papoulis  (1965),  and  Blanc- Lapierre  and  Fortet  (1965) 


(2.61) 


I 


i 

v 
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If  R(t  is  real,  Chen 

♦*x(‘*l,-*2)  ’  *xx"<*r,2>  '  (2  62) 

It  is  easy  to  see  that  the  general  double  transform  (2.59)  reduces 
to  our  previous  result  of  X(t,w)  wide-sense  stationary,  i.e.: 


WV  ■ 


8(62"S1> 


T,  !  *xx(T)  *  dT 


6<VS1>  *„(«!> 


(2.63) 


On  the  other  hand,  if  ^  *  s2  ^  e9ua^  t0  I’xX  (s  ^  )  ,  the 

inversion  formula  (2.60)  becomes 


RX  •<tl't2)  ‘ 


I 


j  W  fc(s2-sl)  e 


‘Vl  +  l,2t2 


d6  ^  d  s^ 


16 , <c,-t ,) 

W  *  "  <«»! 


“xx*  W  '  ^X<,,' 


(2.64) 


which  show  :  that  X(t,w)  it,  a  wide-sense  stationary  stochastic  proceaa. 


Tie  above  results  can  be  summarized  as  the  following  theorem- 


Y(t,«)  *  LX(t,  u.) 

Figure  2.2  -  Linear  Deterministic  Transformation  of 

Stochastic  Process 
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function  of  the  output  process,  if  it  'an  be  assumed  that  the 
expected  value  operator  and  the  linear  operator  can  be  interchanged. 

The  expected  value  operator  and  the  linear  ooerator  arc  interchangeable 
for  practically  almost  all  deteiminist ic  linear  operations.  For 
example,  it  can  be  shown  that  Lhe  differential  and  integral  operators 
are  interchangeable  with  the  exoected  value  operations,  (Pugachev, 

1965,  o.  387  ).  Thus,  the  expected  value  of  Y(t,ui)  is 

<  Y  (t  ,ui)  >  -  <  L  X  (t  w)  >  -  L  ^  X  (t  ,uj)  >, 

or 

Uy(t)  -  Lmx(t). 

It  (2.o7)  is  subtracted  trom  (2.65),  we  have,  according  to 

(2.66) 

Y  (t ... )  -  L  X  (t  .-■)  ,  (2  -68) 

o  e 

where  the  i  ibse  t  int  o  <J«  i  '.<•>  that  Y  (t  ,w)  and  X  (r  ,w)  are  processes 

o  o 

with:  zei  o  ..cans  .  For  zero  mean  processes,  both  the  covariance 
tunc  t  ion  ami  o!tn  iat  tor.  lunations  oi  Y  (t  ,w)  are  given  by  the  same 


(2.67a) 


(2.6/e) 


exp re s s  1 


'Vi 


Y  Y 

o  o 


urt2) 


Y  Y  (t,,~) 


*  <  L  X  (t  ,w)  (L  X  (r^.ui))  > 

T!  0  1  t2  o  , 

-  <  L  L  *  ”  (t ,  ,w)  X  *(t,,u)  > 

t2  1  0  l 

■  <  L  L  <  X  (t,w)  X  *(t, ,w)  > 

T,  T„  0  O  2 


Si  X  'T1 ,T2  ^ 


(2.69) 


where  the  subscript  on  the  operator  denotes  that  the  operator  acts  on 
the  stochastic  process  with  the  same  argument  as  the  subscript.  To 
illustrate  application  of  (2.69),  simple  linear  differential  and 
integral  operators  are  considered.  First,  let  L  be  ~~  (’)•  Then 
by  (2.67b) 


(t) 


d_ 

dt 


PXU)  . 


(2.70a) 


and  by  (2.69), 


*Y  Y  ^tl,t2^ 


2 

a  r,  <t.  ,t,) 

A  A  1  *- 

o  o _ 

c)t^ 


(2.70b) 


For  higher  derivatives,  that  is, 


--  (■)  , 

dt" 


h  (0 


(2.71a) 
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we  have 


and 


Uy  (t) 


“x(t) 


\  Y  ^i,£2^ 


^  *X  X  (Ci*C2) 


o  o 


v  n  .  n 

SC1  *2 


(2 . 71b) 


(2.71c) 


All  these  relations,  (2.70)  and  (2.71),  can  also  be  derived  directly 
from  the  definition  of  the  quadratic  mean  derivative  (2.39). 

Another  important  class  of  linear  operators  are  integral 
operators  of  the  following  type: 


r 

Y(t,u>)  »  J  g  ( t ,  t)  X(t,u>)  dr  ,  (2.72) 

T 


where  g(t,T)  is  a  deterministic  function.  g(t,T)  may  be  a  Green's 
fun  tion  or  the  impulse  r  ponse  of  a  linear  system  From  (2,67)  and 

o  (sQ\  we  ha vp 


and 


I  8(t-T) 

T 


Ux(t)  dt 


(2.73a) 


r 

t 

I 

T  T 


S  Y  (tl,t2)  "  j  /  8(S>T1>  «(t2'T2>  *X  X  (t1*V  dTi  d72 

0  O  o  >7  0  0 


(2.73b) 


j 

i 


The  expressions  (2.?3)  car  be  also  derived  directly  from  the  daf  in  i  *■  i  on 
of  the  quadratic  near,  integrals.  It  is  also  a  special  case  of  the 
integral  (2.40).  The  results  of  this  section  will  be  frequently  used 
in  the  subsequent  chapters  of  this  dissertation. 

The  special  case  of  a  linear  transformation  of  Gaussian  processes 
is  of  interest.  The  characteristic  functional  of  real  stochastic 
processes  X(t,w)  and  Y(t,w)  is 

g^(X.)  -  <  exp  [  i  X  Y(t,ui)  ]  > 

»  <  exp  [  i  X  L  X(t,w)  ]  >  ,  (2.74) 

where  X.  is  a  linear  functional.  For  continuous  stochastic  processes, 

X  is  an  integral 


X  »  J  XQ(t)  Y(t,w)  dt  , 

T 


and  for  discrete  stochastic  processes,  X  is  a  sum 


N 


X 

N 


X  (t  ,w) 
n  n 


(2.75) 


(2.76) 


Since  X  is  a  linear  functional  the  relation  (2.74)  shows  that  the 
characteristic  functionals  for  X(t,w)  and  Y(t,iu)  are  related  by 


g/M  -  8X  r^L] 


(2.77) 
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If  the  '  ®a  i  stochastic  process  X(t,uj)  ha?  a  Gaussian  distribution, 
its  characteristic  functional  is  (Pugac  ev,  i 96 5 ,  p-  193): 

gx(X)  -  exp  [  i  \  ^(t)  '  kt  \  cxx  (f  j  •  C2 )  3  •  (2.78) 

Using  either  (2.77)  or  (2.693  and  (2.67)  the  characteristic  functional 
of  Y(t,w)  is  given  by 


gy(X)  -  exp  [  iXL  nx(t)  -  j  (XL)t  CXx^tl,t2)3 


-  exp  [  iXL  »  (t)  -  ±  \  \  (L  L  C  (r  t  ))  ] 

X  2  tx  t2  tl  t2  XX  i  2 


(2.79) 


This  relation  (2.79)  shows  that  for  Gaussian  stochastic  processes 
the  characteristic,  functional  ..mains  invariant  under  linear  trans¬ 
formation.  Since  the  multivariate  distribution  functions  «'»n  be 
determined  from  the  characteristic  functional,  it  can  be  concluded 
that  a  linear  transformation  of  Gaussian  processes  yields  Gaussian 
processes.  The  spectral  expansion  of  a  Gaussian  process  i6  also 
a  Gaussian  process,  because  spectral  expansion  is  a  linear  trans¬ 
formation  of  a  random  process.  As  ’  vas  r^',t‘>d  before,  ail  the 
multivariate  distribution  function  can  be  obtained  from  the  charac¬ 
teristic  functional.  But,  from  (2.78)  it  can  be  seen  that  the 
characteristic  functional  for  the  Gaussian  process  is  completely 
determined  if  the  mean  .,,.d  covariance  of  the  process  are  known, 
fvnee,  a  Gaussian  process  is  completely  determined  if  its  mean 
and  covariance  are  known.  For  the  same  reason  a  wido-sense  stationary 
Gaussian  process  is  also  strictly  stationary. 


5  i* 


Theorem  2 .  A  second  order  stochastic  process  X(t,uj)  is  wide-sense 
stationary  if  and  only  if  its  bifrequency  power  spectral  density 
®xx(sr82)  is  e£*ua ^  t0  ^^82  6i^  ®xx^8i^  -or  e<iuiva i^Htiy  to 

'Vi1  Wi- 

This  result  will  be  used  in  Chapter  IV  to  identify  wide-sense 
stationary  and  non s ta t ionary  components  of  a  random  wave  function. 

This  is  done  by  computing  the  bifrequency  spectral  density  0  (s.,s0) 

and  identifying  the  coefficients  of  6(s„-e  )  as  the  wide-sense 
stationary  parts  of  the  spectral  density.  The  terms  which  do  not 
contain  6(s2~8j)  are  identified  as  nonstationary  parts  of  the  spectral 
density. 


2.8  Linear  Transformations  of  Stochastic  Processes 

In  this  section  some  of  the  known  results  from  linear  determin¬ 
istic  operator  theory  are  presented.  A  linear  deterministic  system 
Is  shown  in  Figure  2.2.  Let  the  input  to  the  system  be  X(t,u»)  and 
the  output  to  the  system  be  Y(t,w),  teT  and  wefi  on  the  probability 
space  ((2,Z,P).  Mathematically  the  relation  between  the  input  and 
output  i6 


Y(t,u)  -  L  X ( u , w) , 


(2.65) 


where  L  is  a  linear  operator.  (An  operator  L  is  said  to  be 
linear  if 


L  [a  xL(t)  +  b  x2(t)]  -  a  L  x^t)  +  b  L  x2(t)  (2.66) 


for  every  constant  a  and  b,  and  for  everv  function  x.(t)  and 

i 

Xj(t).]  It  is  easy  to  compute  the  expectation  and  the  covariance 


i 
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i 
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t 
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2 . 9  De  f  i  n  1 1  i  on s  ...  d  The  or  + r  'r*  L  he  Theory  of  Rand  on,  *.  a  tor  < 

Ec!,>^  t 

Probabilistic  fimrr-inn.il  analysis,  developed  mainly  by  Spacek  < 

(1955),  Hans  (1961),  and  Bharucha - ke id  (1960,  1964,  1965)  provides  i 

! 

rigorous  definitions  and  useful  existence  theorems  for  random  operator  • 

equations.  The  main  results  of  this  work  have  been  conveniently 
summarized  by  Hans  (1961).  Some  of  the  definitions  and  theorems  that 
are  used  later  in  this  dissertation  are  extracted  from  his  work. 

Let  (12,2,  P)  denote  a  probability  space  with  a  complete  probability 
measure  P;  that  is,  Q  is  a  non-empty  set,  2  is  a  g-aigebra  of  subsets 
of  the  space  12,  and  P(A)  is  a  probability  measure  defined  on  the  set6 
A  of  2. 

In  Liiis  section,  X  and  Z  are  arbitrary  separable  Banach  spaces,  . 

£  and  o  the  g-algebras  of  all  Borel  bsets  of  the  spaces  X  and 

n 

Z,  respectively  (Zaanen,  1953).  j 

'text,  the  concepts  of  "generalized  random  variable"  and  "random  * 

« 

transformation"  are  defined.  1 

! 

A  mapping  V  of  the  space  U  into  the  space  Z  is  called  a 
genera  1  lzed  rand om  variable  if  {*);  V (w)  eB)  e2  for  all  BfS. 

Two  generalized  random  variables  V(u>)  and  W(w)  are  said  to  be 
equ iva Lent  if  V(w)  »  W(w)  with  probability  one. 

A  mapping  T  of  the  Cartesian  product  space  fi  \  X  into  the  space 
Z  is  called  a  random  transformation  if  T(-,x)  is,  for  every  xeX, 
a  generalized  random  variable. 

In  tlie  most  general  form,  a  random  operator  equation  is  written  as 


T  [w,x(w)|  ■  Z  (co) 


(2.80) 


bb 

where  T  is  a  random  tr instormation  of  the  Cartesian  product  space 
fl  x  X  into  the  space  Z.  z  is  a  generalized  random  variable  *ith 
values  in  the  space  Z-  As  is  seen  from  (2.8C),  the  solution  of  a 
random  operator  equation  does,  in  general,  depend  on  the  choice  of 

wefi.  If  the  solution  of  (2.80)  satisfies  the  measurability  condition 

* 

(i.e.,  it  is  a  random  variable  )  we  call  it  a  random  solution  of  the 
operator  equation.  Hence,  the  following  definition: 

Every  generalized  random  variable  x  with  values  in  the  soace 
X  satisfying  the  condition  T  [u),x(uj)]  »  z(u>)  with  probability  one  will 
be  called  the  random  solut ion  of  the  random  operator  equation  (2.80). 
e  following  theorems  which  are  useful  for  our  investigation 

V 

hav.  been  stated  and  proved  by  Hans  (1961). 

Theorem  3.  Let  T  be  an  almost  surely  linear  bounded  random  transforma¬ 
tion  of  the  Cartesian  product  space  U  x  X  into  the  space  X.  Then 
for  every  real  number  X.  i  0  such  that 

JO 

P  (Un-1  (w:  ||  T°  (w,0  ||  v  |\|n  ))  -  1  ,  (2.81) 

there  exists  a  linear  bounded  random  transformation  S  that  is  the 
inverse  of  me  mndom  transformation  (T  -  \1)  and  it  satisfied 

P  (fi  v  (w:  S (w , x )  -  (-1/X)  L°  .  \'n(w,x)})  -  1  (2.82) 

xcX  n«l 

where  the  sum  converges  uniformly.  I  denotes  the  Identity  operator, 
and  ||  jj  denotes  the  norm  in  the  Banach  space  (Zaanen,  1 9 S U ) . 

* 

Discussed  in  section  2.2. 
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In  many  applications,  it  is  sometimes  convenient  to  use  a 
different  version  of  the  above  theorem. 

Theorem  4 .  Let  T  be  a  random  t rana f orma t ion  of  the  Cartesian 
product  SDace  Q  x  X  into  space  X  which  is,  for  every  wefl,  linear  and 
bounded.  Then,  for  every  real  number  X  4  0,  the  set 

fi(X)  -  (u:||T(u»,.)||  <  N)  (2-83) 

belongs  to  the  oalgebra  2,  t!  e  random  transformation  (T-XI)  is 
invertible  for  every  u)eil(X),  the  resolvent  operator  r(u,*7w,')  exists 
for  every  u.'efl(A.)  and,  for  these  u),  the  resolvent  operator  is  given  by 

r(w,\,  •)  -  X'n  t"’1  <«,•)  .  (2.84) 

Furthermore,  for  every  the  solution  a  (u)  of  the  operator 

equal  ion 


T(uj,r)  -  \r  -  z(uj)  (2.85) 

is,  for  “very  generalized  random  variable  z  with  values  in  the  space  X, 
given  by 

s(w)  ■  r[ r  (u-1)  ]  (2.86) 

wheie  the  resolvent  operator  r(“>,X,-)  and,  consequently  also  the 
solution  s,  are  measurable  with  respect  to  the  o-algebra  fi(X)/"l2- 

Next,  three  theorems  which  are  useful  in  establishing  the  exist¬ 
ence  of  solutions  of  the  random  integral  equations  are  stated.  Let  C 


! 


! 


denote  the  space  of  all  continuous  functions  defined  on  the  closed 
interva 1  [0,d ] ,  0  <  d . 


bb 


It  the  norm  x  is  give  by 

||  x  ]|  -  muX  |  x  ( u )  |  ,  0  <  u  <  d,  (2.87) 

the  space  C  becomes  a  separable  Banach  space. 

First,  a  theorem  that  gives  the  relationship  between  the 
measurability  of  the  random  integral  operator  and  the  measurability 
of  its  kernel  16  stated.  Let  K  denote  the  space  cf  all  functions 
k  defined  and  bounced  on  the  set  [0,d]  x  [0,d]  all  of  whose  discon¬ 
tinuity  points  are  located  on  a  finite  number  of  curves  v  ■  t^(u) 
and  such  that  for  every  uc[U,d],  ve[0,d],  and  for  every  sequence 

of  real  numbers  d  >  6,  >  &„  >  •  •  •  >  b  -»  0,  we  have  k(u,0)  ■ 

“12  n 

lim  k(u,6  )  and  k(u,v)  ■  1 im  k(u,v-6  ),  provided  6  <  v  in  the 
p— no  n  p~*  ®  n  1~ 

latter  case.  If  Lite  norm  of  k  .s  jj  k  ||  •  sup  |k(u,v)j,  where 
sup  is  taken  over  u  e[0,d]  and  v  e[0,d],  then  it  can  be  shown  that 
K  is  a  separable  norroed  linear  space. 

Theorem  5-  Let  k  be  a  mapping  of  the  space  ft  into  th-1  space  K  and 
let  the  mapping  T  ot  the  Cartesian  product  space  ft  x  C  into  the 
space  C  be  defined  for  every  u)*ft  by 

o 

r 

T(uj,x)  ■  k ( u) ,  •  , u )  x(u)  du  (2.88) 

0 

Then,  the  mapping  T  is  for  every  weft  a  compact  linear  transformation 
of  the  apace  C  into  itself  Furthermore,  T  is  a  random  tr-naf ormat ion . 

The  next  theorem  gives  a  sufficient  condition  for  the  irrverti- 
bility  of  a  linear  random  transformation. 


Theorem  b  Le:  ail  the  assunmt  ions  of  Theorem  5  be  fulfilled.  Let, 
in  addl,  ->n ,  the  real  number  X  satisfy  the  inequality 
d  ||k(u),  •  ,  •  )!i  <  ! X 1  with  probability  one.  Then  the  linear  random 
tra  -'sf  orcid  t  ion  (T  -  XI)  is  invertible;  that  i6, 

?  {w:(w.X)  €D(T))  -  l,  (2 . 89 

where  p(l)  dei.otes  rhe  «"t  of  those  pairs  (~,\)  x  R  iut  which 
the  linear  random  trana forma c ion  (T  -  XI)  has  a  linear  bounded  inverse 
R  denotes  the  real  number  axi6. 

The  above  tneorem  applies  to  random  Fredholm  integral  equations. 
The  next  theorem  is  Its  analogue  tor  the  Volterra  kernels 

Theorem  7 ■  Let  ail  the  assumptions  of  Theorem  5  be  fulfilled.  Let, 
in  addition,  the  kernel  k  satisfy  the  condition 

P  (ui.  k(ip,u,v)  “  0)  -  1  for  every  0  <  u  <  v  d .  Then,  for  every 
re.  I  number  X  i  0  the  linear  random  transformer  ion  (T  -  XI)  is 
invert  ib  le  . 

Piooi.  Similarly  to  the  classical  rroof  of  the  convergence  of 

★ 

Volterra  integral  equation  ,  it  follows  that  for  almost  every  veil 
and  every  n  -  1,2 .  we  have 

‘  T n  ( co ,  '  )  j i  v  jxdj11  !lk(ui,  •  ,  •  )|jn  /n  !  (2*1 

Hence,  Theorem  3  is  applicable  and  the  Neumann  series  expansion  (2.81) 
converges  uniformly. 

The  above  theorems  give  suiiicient  conditions  tor  the  existence, 
uniqueness,  and  measurability  cf  tendon  solution  of  the  randan 


if 

Zeenen  (Hoi) 
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operator  equations.  These  are  sufficient  conditions;  that  is, 
solutions  may  also  exist  under  wecker  conditions.  Unfortunately, 
no  necessary  and  sufficient  conditions  are  known  for  the  existence 
of  a  solution  of  the  general  random  operator  equations.  The  main 
restriction  in  all  the  above  theorems  in  that  T  is  almost  surely 
linear  and  bounded. 

Many  interesting  stochastic  processes  are  not  bounded,  hence  the 
preceding  theorems  are  not  strictly  applicable.  We  can  use  a  trunca- 

v 

cion  method,  suggested  by  Loeve  (1963),  to  overcome  this  difficulty. 
The  random  variable  X(ui)  is  trurca ted  at  c  when  we  replace  X(w)  by 


X  (w) ,  where 


XC(u)  -  X(u>)  if  jx(us)  |  <  c, 
XC(w)  -  0  if  |X(w)|  >  c  , 


c  >  0  and  finite . 


(2.91) 


Then,  all  the  moments  of  X  (u>)  exist  ~nd  are  finite.  We  can 
always  select  c  sufficiently  large  so  as  to  make  P  [X(w)  4  X  (ui)  ]  *» 

P  [  j X (uo)  |  >  c]  arbitrarily  small.  Whenever  boundedness  of  the 
stochastic  processes  ie  needed  in  the  applicstion  of  the  preceding 
theorems  (Theorems  3  through  7),  it  is  assumed  that  the  stochastic 
processes  are  truncated  in  the  above  sense. 
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CHAPTER  III 


GENERAL  METHODS  OF  SOLUTION 

3 . I  lntroduc  t Ion 

In  this  chapter,  two  methods  tor  solving  differential  equations 
with  randomly  time-varying  coefficients  are  developed.  In  the  first 
case,  we  consider  a  stochastic  differential  equation  of  the  form 


£  y(t,^)  -  x(t,w)  , 

where 


£ 


and  x(t,iv)  and  the  a^(t,ui)  are  random  functiona  whose  statistics  are 
known  and  defined  on  teT,  on  (ft,Z,P).  (ft,2,P)  denotes  a  probability 

measure  space;  i.e.,  ft  is  a  non-empty  abstract  set,  2  is  a  o  algebra 
of  subseto  of  ft,  and  P  is  a  complete  probability  measure  on  2.  It  is 
further  assumed  that  the  random  operator  £  is  the  sum  of  an  invertible 
operator  L  and  a  random  operator  R  The  objective  is  to  determine  a 
stochastic  Green's  function  (Adoinian,  i 964 )  for  the  stochastic 
operator  £  in  terras  of  the  deterministic  Green's  function  for  L  and 
the  appropriate  "statistical  measures"  of  the  forcing  function  x(t,w) 
and  the  randomly  time-varying  coefficients  a(t,w).  The  term  "statistical 
measures"  is  used  as  a  general  term  for  the  quantities  that  characterise 
stochastic  processes.  For  example,  expectations  or  means,  spectral 
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densities  and  correlation  functions  are  statistical  measures.  The 
integral  kernel  which  expresses  the  desired  statistical  measure  of 
the  output  process  in  terms  of  the  corresponding  statistical  measures 
of  the  input  and  appropriate  statistical  measures  of  the  stochastic 
coefficients  is  called  the  "stochastic  Greer's  function".  Adooiian 
(1967)  has  developed  an  iterative  process  for  finding  the  stochastic 
Green' 6  functions  for  the  expectation  and  the  autocorrelation  function 
of  the  output  process.  This  iterative  method  achieves  the  desired 
separations  of  ensemble  averages  without  a  priori  restrictions  to 
perturbation-type  approaches  or  recourse  to  the  generally  non-valid 
closure  approximations  of  the  hierarchy  equation  methods. 

The  similarity  between  Adomian's  iterative  method  and  the  solution 
of  an  integral  equation  by  means  of  Neumann  series  suggests  that  the 
stochastic  Green's  function  can  be  expressed  in  terms  of  the  determin¬ 
istic  Green' 8  function  for  the  operator  L  and  the  resolvent  kernel  for 
the  Volterra  integral  equation.  In  this  chapter,  the  ensemble  average 
and  correlation  function  of  the  dependent  variable  are  expressed  in 
terms  of  the  Green's  function  of  the  operator  L,  the  average  and  the 
correlation  function  of  the  forcing  function  x(t,w)  and  the  resolvent 
kernel  of  the  Volterra  integral  equation.  The  resolvent  kernel  is  a 
function  of  appropriate  statistical  measures  of  the  random  coefficients 
and  the  Green's  function  of  the  deterministic  operator.  By  finding  the 
resolvent  kernel,  the  solution  of  the  problem  of  finding  the  average 
and  the  correlation  function  of  the  dependent  variable  is  expressed 
for  a  class  of  forcing  functions.  The  Neumann  series  expansion  is 
exceedingly  laborious;  for  this  reason,  other  methods  for  solving  the 
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problem  are  investigated.  The  solution  of  the  stochastic  integral  j 

equation  is  simplified  if  the  kernel  of  the  Integral  equation  la 

degenerate.  In  many  cases,  the  problem  of  solving  a  stochastic 

differential  equation,  with  a  time  invariant  deterministic  part, 

reduces  to  a  problem  of  solving  an  integral  equation  with  a  degenerate 

kernel.  Three  different  cases  of  degenerate  kernels  are  considered.  ! 

In  the  first  and  simplest  case,  the  degenerate  kernel  consists  of 

a  single  term.  In  the  second  case,  the  degenerate  kernel  is  a  sum 

of  n  products.  In  the  third  case,  the  degenerate  kernel  is  a  product 

of  the  state  transition  matrix  and  a  matrix  if  stochastic  coefficients. 

The  last  case  is  applicable  to  the  state  space  formulation  of  control 
system  problems  where  the  system  matrix  is  the  sum  of  a  deterministic 
time -invariant  matrix  and  a  stochastic  coefficient  matrix.  j 


3.2  Integral  Equation  Formulation  and  Solution  by  Neumann  Series 
Expansion 

Following  Adomian's  (1967)  approach,  let  £  be  an  order 
stochastic  differential  operator,  such  that 


n_^ 

£ .  ■  )  a(t,u>)  ““  ,  (3.1a) 

/  .  dt 

v°0 

where  a^(t,w)  are  random  functions,  teT  and  wrfl  (Q,Z,P).  Let  the 
operator  S'  be  separable  into  a  deterministic  operator  L  and  a  random 
operator  R.  In  particular,  let  the  random  coefficients  of  £.  be  of  the 


form 
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i 


av(t,w)  -  0v(t)  +av(t,w)  ,  (3.  lb) 

where  f^(t)  are  deterministic  functions  of  time  and  a  (t,u*)  ave 
stochastic  processes,  f5^(,t)  can  either  the  ensemble  average  of 
a^(t,i»)  or  some  other  convenient  function  of  time.  For  example ,  it 
may  he  possible  to  choose  so  that  the  inversion  of  the  determin¬ 

istic  differential  operator  L  is  simplified.  It  is  assumed  that  L  is 
an  invertible  differential  operator;  that  is,  the  Green's  function 
G(t,T)  for  the  differential  operator  L  is  known  or  can  be  constructed. 
One  can  associate  with  the  operator  £  a  stochastic  differential 
equation 

£  y(t,<a)  *  x(t,iu)  teT  and  u>€ft  on  (fi.Z.P). 


The  forcing  function  x(t,w)  car.  be  either  deterministic  or  random. 
For  greater  generality,  let  it  be  random.  It  is  also  assumed  that 
x(t,w)  is  statistically  independent  of  the  random  coefficients.  By 
the  assumption  that  £  ■  L  +  R,  the  equation  (3.2)  can  be  written  as 
follows : 


where 


L  v(t,w)  -  x(t,uj)  -  R  y(t,w) 


(3.3a) 


(3.3b)  j 

i 

i 


o 
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and 


K 


C  (t,w) 

v 


(3.3c) 


By  the  ajisun.pt  ion  that  t'»'e  Green's  function  for  the  deterministic 
operator  L  is  known,  (3.3)  can  be  converted  into  an  integral  equation: 


y(t,w) 


L  1  x(t,u))  -L  1  R  y  (t  ,uj) 


(3.4a) 


where , 


and 


t 

f  dr  G(t,r) 


o 


t 

J  dT  G  (t ,  r ) 

o 


ay(i  ,ui) 


(3.4b) 


(3.4c) 


The  u«e  of.  0  as  the  lower  limit  assumes  that  either  the  system  was 
initially  at  rest  or  the  initial  conditions  have  been  taken  into 
account  in  the  construction  of  the  Green's  function  G(t,r).  The  upper 
limit  is  t.  tor  causal  systems  since,  for  causal  systems,  G(t,r)  • 
for  t  <  t.  To  simplify  the  notation,  let 


...  i 

L  Jt(t,w)  -  F(t,u>), 


(3.5s) 
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And  let 


n 

K(t,T)  «  G(t,r) 

v-0 


L 


Ov(t,w) 


(3.5b) 


With  this  notation,  Equation  (3.4)  can  be  expressed  as  an  integral 
equation  which  resembles  the  Volterra  integral  equation: 


y(t,u»)  -  F(t  ,(*))  +  \  /  K(t,r)  y(r,u>)  dr 


(3.6) 


In  this  case,  X  ■  -1.  The  solution  to  Equation  (3.6)  can  be  expressed 
analogously  to  the  Neumann  series  solution  <n  terms  of  iterated  kernels 
(Courant  and  Hilbert,  1953;  and  hildebrand,  1952): 


y(t,w)  -  F(t,ui)  + 


I  A 

o 


(t , t)  F(t,w)  dr 


m"l 


(3.7) 


where  K  (t,r)  is  defined  by  the  recurrence  formula 


K  (t.T) 
m 


K(t,Tl) 


m-i 


(tl,t)  dtL 


(3.8a) 


and 


K^t.r)  -  K(t , t) 


(3.8b) 
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If  the  sum  converges  uniformly,  the  order  of  sunmation  and  integration 
can  be  interchanged  in  (3.7),  which  then  becomes: 


t 

y(t,w)  ■  F(t ,u>)  +  \  / 

o 


Z  ^  Km+l(t'T)  F(T*U)dT  ]  * 
m-0 


(3.9) 


Then  equation  (3.9)  can  be  written  in  terms  of  the  resolvent  kernel 
rtt.T.w)  as  follows: 

t 

r 

y(t,w)  -  F(t ,<*))  +  K  I  r(t,T,\„w)  F(t,w)  dT  ,  (3.10a) 

o 


where 


r(t,T,\,w) 


(t,T,\,Ul). 


(3.10b) 


Since,  in  this  case,  K  is  -1,  the  resolvent  kernel  is  written  from 
now  on  without  \  in  its  argument.  At  tnis  point,  we  have  nothing 
essentially  different  from  classical  differential  equation  theory. 
The  difficulty  arises  because  y(t,w)  is  not  a  physically  significant 
quantity,  only  its  statistical  measures  are.  The  mean  value  of  rh' 
dependent  variable  y(t,w)  can  be  computed  by  taking  the  ensemble 


Discussed  later  in  thi  .  section. 
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average  of  equation  (3.10).  It  must  be  noted  that  because  of  the 
assuootlon  that  the  random  coefficients  and  forcing  function  are 
independent,  the  problem  simplifies  in  that  the  resolvent  kernel 
r(t,r,w)  and  F(t,w)  are  statistically  independent  of  one  another. 

Hence,  the  ensemble  averages  separate  and  the  ensemble  average  of 
y(t,w)  is  given  by: 

L 

r 

<  y(t,u>)  m  <  F(t,w)  >  -  I  <  I'(t,T,w)  >  <  F(t,w)  >  dT  , 

O  (3.11a) 

where  from  (3.4b)  and  (3.5a) 

t 

<  F(t,w)  >  ■  J  G(c,t)  <  x(t,u)  >  dT  .  (3.11b) 

o 

In  this  case,  the  stochastic  Green's  function  is  simply  <  i(t,T,w)  >. 

Similarly,  the  autocorrelation  function  of  y(t,ia)  can  be  computed. 
For  greater  generality,  y(t,;c)  is  taken  to  be  a  complex  function.  Then, 
the  autocorrelation  function  of  y(t,w)  denoted  by  R^^(t^,t,)  is: 
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*  <  F(t1(u)  F*(t2>w) 


-  /  <  rCtj.tj.w)  >  <  F(rltu))  F*(t2.u)  >  dT 
o 


/  *  ★ 

'  !  <  r  (t2.T2,u)  >  <  F(tj,w)  F  (t2.u>)  >  dT2 

o 

r  1  c2 

r  r  * 

+  J  J  <  r(VTrU)  r  (t2-T2*uj)  >  <  F(Tr«.)  F*(t2,u.)  >  dr  dr2  . 
0  0 

(3.12a) 


The  quantity  <  F(t^,u>)  F  ( c  2 ,  uj)  >  can  be  denoted  by  RyyUj.tj)  and 
(3.12a)  can  be  written  more  compactly  as: 

vw  -  vw 


/  <  r<t, .’!■“)  'VW  dTi 


r  >  *FF <W  dTj 


'i  b 


+  ! 


<  r(t1»Tj.w)  r  (C2  *  T2  »w)  V  *Vf^T1,T2^  dTl  dT">  '  C3 . 12b ) 


o  o 
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where 


RFF(trC2) 


"1  ^2 

nr*  * 

I  i  ^  i  ’  Ti  )G  (t2>T2^  <  *(T1»W)  x  (t2>uj)  >  dTi  dT2 
o  o 


(3.12c) 


Equation  (3.12)  looks  quite  complicated,  yet  it  expresses  one  of 
the  noat  important  properties  of  y.  It  is  unfortunate  that  many 
of  the  interesting  properties  of  y  are  given  by  nonlinear  functions. 
If  the  coefficients  of  the  differential  operator  are  strictly  deter¬ 
ministic,  then  the  .ast  terms  in  (3.12b)  vanish  and  {(^(tj.tp)  la 
given  by  (3.12c)  which  agrees  with  the  well  known  result  tor  non- 
random  systems.  The  cross  correlation  between  the  output  and  input 
can  be  alao  found  by  using  equation  (3.10): 


R  (t  ,t  )  -  <  y ( t .  ,^i)  x  (t,.w)  > 

yx  i  l  i  i 


C(t  i t  )  R  (r  , t  )  dT 
l  l  xx  1  2  1 


1  1 

j  <  r(ww)  /  ^i-V  R«{VV  %/d,r 

o  o 


(3.13) 


Examination  of  equations  ( 3 . 11),  (3.12b)  aid  (3.13)  sheds  some 
light  on  the  stochastic  Green's  functions  (Adomian,  1964)  for  a 
differential  operator  which  can  be  separated  into  a  sum  of  the  deter¬ 
ministic  operator  L  and  the  random  operator  R.  In  all  three  cases, 
the  first  term  in  the  expressions  is  due  to  the  detenu  in  is t  ic  operator 
alone.  If  the  randomness  of  the  coefficients  of  i’  vanishes,  only  the 
first  terms  remain.  The  succeeding  terms  are  -omplicated  functions  of 
random  coefficients  and  deterministic  Green's  function  for  the  operator 
L.  When  higher  order  coefficients  (v  >  1)  ere  random,  construction  of 
the  resolvent  kernel  involves  differentiation  as  indicated  by  (3.5b). 
This  is  not  too  surprising  for  a  relatively  complicated  problem.  In 
other  physical  problems,  similar  complies tions  arise,  For  example, 
an  expression  for  the  dyadic  Green's  function  associated  wfth  the 
solution  of  a  vector  wave  equation  involves  differentiation  (Levine 
and  Schwinger,  1951)  - 

In  the  actual  solution  of  problems,  construction  of  the  resolvent 
kernel  presents  major  difficulties.  As  shown  by  Adamian  (1967), 

Neumann  set ies  type  of  iteration  can  he  successfully  used  when  the 
lowest  order  coefficient  is  stochastic.  This  type  of  Iteration  haa 
the  advantage  that  the  previously  computed  term  Is  used  in  the  next 
term  and  so  on.  One  can  stop  the  iteration  at  any  time  when  the  re¬ 
mainder  term  becomes  smaile.  than  s  prescribed  value. 

When  only  the  lowest  order  coefficient  a  la  a  random  function, 

o 

it  is  easy  to  show  the  convergence  of  the  Neumann  series  expansion 
(3.7),  Sufficient  conditions  for  the  uniform  convergence  of  this 
Neumann  series  expansion  are  simnlv  the  hypotheses  of  Theorem  5  and  7 


n 


of  section  2.9.  The  hypotheses  of  Theoiem  5  require  that  G(t,T)  a  (t,u)) 
is  a  mapping  of  the  space  fi  into  space  K  and  thar  the  maDping 


dT  G(t,r)  Li  (t.o)  F(t,jj) 
o 


of  the  Cartesian  product  space  ft  x  C  into  the  space  C  is  defined  for 
every  u left  and  every  F(t,vi)  e  C.  C  denotes  the  space  of  ail  continuous 
functions  defined  on  the  closed  interval  [0,d],  l  <  d.  The  soace  K 
has  been  defined  in  section  2.9,  The  additional  hypotheses  of 
Theorem  7  simply  state  that  the  kernel  of  th"  integral  equation  is 
a  Volterra  kernel  wit:  prob  llity  one  Under  these  conditions,  the 
integral  equation  (3.6)  is  invertible  and  the  Neumann  series  expansion 
converges  uniformly. 

When  the  higher  order  coefficients  arc  also  stochastic,  it  is 
more  difficult  to  carry  out  the  Neumann  s  ties  expansion  and  to 
establish  the  sufficient  conditions  for  the  convergence  of  the  series. 
It  can  be  seen  from  (3.5)  that  the  expansion  as  it  stands  requires 
differentiation  in  adoption  to  integration.  For  computation  and  for 
investigation  of  convergence,  it  is  convenient  to  express  the 
order  differential  equation  as  n  first-order  differential  equations 
which  are  in  the  matrix  form: 


y(t,w)  -  a(c,w)  y(t,w)  +  U  x(t,ui) 


(3.14) 


n 


where  y(t,^)  and  y(t,a)  are  n-d imens iona 1  vectors,  a(t,u>)  is  an  n  x  n 

coefficient  matrix,  U  is  an  n  x  r  matrix,  and  x(t,cj)  is  an  r-d imens iona  1 

vector.  Tills  allows  the  system  to  have  r  different  inputs.  In  the 

single  forcing  function  case,  r  is  equal  to  one.  In  control  system 

-heory,  this  matrix  formulation  is  called  state  space  representation. 

f  h 

The  methods  of  converting  the  single  n  order  differential  equation 
into  state  space  representation  are  discussed  in  many  texts  on  control 
system  theory  and  need  no  elaboration  here  {Schultz  and  Melsa,  ’967; 
JeRusso,  Roy  and  Close,  1965;  and  Lapidus  and  Luus ,  1967).  Because 
of  the  original  assumption  that  the  differential  operator  can  be 
expressed  as  a  sum  of  a  deterministic  operator  and  a  stochastic 
operator,  we  assume'  that  the  coefficient  matrix  a(t,w)  can  be  expressed 


a(t,w)  »  3(t)  +  o(t,w) 


(3.15) 


where  @(t)  is  a  matrix  with  deterministic  elements  and  aft,1**)  is  a 
matrix  with  stochastic  elements.  Using  (3.15),  the  differential 
equation  (3.14)  can  again  be  written  in  the  integral  equation  form 


y(t,w)  -  F(t,w) 


<D(t  ,t)  q(t,u>)  y(r,w)  d-r. 


where 


(3.16a) 


dt  <l>(t,T) 


(3.16b) 
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is  the  inverse  operator  oi  :he  differential  equation 


y  (t  =■  3(t)  y(t,w) 


(3.17) 


The  term  F(t,w)  is  obtained  by  applying  the  inverse  operator  (3.16b) 
to  all  forcing  terms  and  non-zero  initial  conditions.  In  control 
system  terminology,  <f>(t,T)  is  called  the  state  transition  matrix.  in 
this  case,  A,  is  equal  to  one.  The  Neumann  series  expansion  of  (3.16a) 
gives  che  following  iterative  solution: 


y(t,w)  -  Y,  K "  yn<t»w) 

-  n*»C 


yo(t,w)  -  F(t,u) 


t. 

y,(t,u)  ”  j  «(t,T>  q(t,u))  yo(r,w)  dr 

o 


t 

I  $ ( t , t)  o(t,w)  F(t,w)  dT  , 
o 


(3.18) 


or.  In  general, 


yn(t.w> 


«(t,r)  a(T,w)  y  (t ,ta)  dr 

_  n- 1 _ 


o 
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As  before,  the  resolvent  kernel  for  the  integral  equation  (3.16)  can  ; 

i 

be  written  in  terms  of  iterated  kernels  by  j  ] 

'  i 

i 

*  | 

r(t,T,\,“)  *  Yj  A*  Kn+1(C,T,U>)  , 

- n*0 

where  the  iterated  kernels  are  defined  by  the  recurrence  formula 

f 

K  (t.T.w)  -  K(?,r  )  K  (t  ,t)  dT 

D  1  Cl-  1  1  X 

- — ”  O  — - - 

and  K^t.tjW)  -  K(t,T,w)  -  <f(t,T)  a(T,u))  .  (3. IS) 

The  solution  to  the  matrix  stochastic  differential  equation  (3.14) 
can  be  written  in  terms  of  the  matrix  resolvent  kernel  as 

t 

y(t,co)  *  F(t,u;)  +  K  !  r(t,T,>v,ia)  F(t,u>)  dT  .  (3.20) 

-  yJ  - -  ■  ■  - - - 

o 

This  expression  is  completely  analogous  to  (3.10).  Construction 
of  the  resolvent  kernel  in  (3.10)  requires  differentiation  in  addition 
to  integration,  whereas,  in  this  case,  the  resolvent  kernel  can  be 
constructed  by  Iterated  integration  and  matrix  multiplication.  The 
previously  computed  terms  are  used  iu  compute  the  next  term  anH  so  on. 

The  ensemble  average  of  y(t,w)  Is 

t 

f 

<  y(t,w)  >  -  <  F(t,w)  >  +  /  <  r(t,T,»)  >  <  f(t,u>)  >  dT  . 

o 


(3.21) 
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The  stochastic  Green's  function  for  the  ensemble  average  of  y(t,w)  is 
simply  <  r(t,T,w)  >.  The  expression  for  the  covariance  matrix  is 

<  y (c x ,UJ)  yi"(t2,u)  >  •  <  F(t1?u))  Ft(t2,w)  > 

5  2 

+  /  <  F{t^,u>)  F^(t,ui)  >  <  rt(t2,r,u.')  >  dr 


+  /  <  TCt^r.w)  >  <  F(t,u))  FT(t2>ta)  >  dr 


C1  p  C2 


+  /  j  <  rCt^T.u.)  F(t,u)>  F^(0,U))  r+(t2,o,w)>drdo  , 


o  o 


(3.22) 


4, 

where  1  denotes  complex  conjugate  transpose  (hermetian  conjugate)  of 
the  matrix.  The  ensemble  averages  of  (.3.22)  also  separate  In  the 
last  term  because  r(t,T,  *>)  and  F(t,w'  are  statistically  independent, 
but  this  cannot  be  shown  with  the  matrix  notation  because  the  order 
of  matrix  multiplication  must  be  preserved.  Separation  of  ensemble 
averages  takes  place  after  he  matrix  multiplication  has  been  carried 
out . 

A  sufficient  condition  for  the  convergence  of  the  Neumann  series 
(3.19)  can  be  given  by  a  theorem  analogous  to  Theorem  4  of  section  2.9. 


) 
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iheo£eci  1,  Let  <J>(t,r)  a (t,w)  ■  k  be  a  mapping  of  the  space  ft  into 
* 

the  space  K  and  let  the  mapping  T  of  the  Cartesian  product  space 
ft  x  C  into  the  apace  C  be  defined  for  every  weft  and  every  F(t,w)  e  C 


by 


t 


o 


(3.23) 


In  addition,  let  the  kernel  $(t,T)  a(r,w)  satisfy  the  condition 


P  (u:  <f(t,T)  a(r,w)  «*  0}  •  l 


U-24) 


for  every  0  <  t  <  r  <  d,  then  the  integral  equation 

t 

n 

y(t,w)  •  F(t,w)  +  \  I  ®(t,r)  a(r,w)  y(r,w)  dT 

o 

is  invertible  for  every  finite 

Proof.  Consider  the  norms  of  the  iterated  solution: 


where  J|  jj  denotes  any  suitable  norm  for  the  matrices  in  the  Banach 
space . 

t 

II  yQ(t»w)  II  ■  II  /  «(t,T)  a(t,w)  yQ(T,w)  dr  || 

- 1  — «  m  .j  1  '  ■  -  .  —•  i  <  ■  iii 

O 


The  apace  K  has  been  defined  in  section  2,9, 


i 

! 
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<  t  ||  4>(t,T)  civt.w)  j|  ||  F(t,w)  ||  . 


The  last  step  follows  because  Che  norms  jj  ®(t,T)  ct(t,u)  ||  and 
|j  F(t,w)  ||  are  real  non-negative  numbers. 

c 

II  y2(t,w)  ||  -  ||  /  4>(t,r)  rr(T,iv)  y^T.w)  dT  || 

o 

t 

<  j  T  ||  4(1, t)  a(T,w)  II2  II  F(T,w)  ||  dT 

o 


2  2 
<  -yr  II  4>(t,T)  a(T,u>)  ||  ||  f(t,w>  || 

or,  in  general, 

II  yn(t,w)  ||  <  JT  II  't'U.r)  a(t,w)  ||n  ||  F(t,w)  || 

(3.25) 

or  the  norm  of  the  t ransforraa r ion  Tn  satisfies  the  following 
inequa lit/ 


I!  Tn  ||  < 


||  $(t,T)  a(T,w'  ||n  . 


(3.26) 
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Hence,  by  Theorem  3  of  section  2.9,  tie  integral  equation  is  invertible 
and  its  Neuman;,  series  expansion  converges  uniformly  for  all  finite  t 
and  k.  In  this  case,  X  ■  1. 

Sufficient,  conditions  have  been  given  for  the  invert ib i  1  ity  of 
the  stochastic  integral  equation  (3.16)  and  for  the  convergence  of  the 
Neumann  series  expansion.  These  conditions  state  that  the  solution 
exists  for  almost  all  sample  functions,  but  the  theorems  say  nothing 
about  the  existence  of  expected  value  or  covariance  of  the  solution. 

The  sample  fane* ions  y(t,u)  may  not  be  second-order  stochastic  pro¬ 
cesses.  A  st)chastic  process  y(t,u>)  is  said  to  be  second  order  if 
2 

<  |  y(t,w)  |  >  <  «>  is  satisfied. 

Consider  now  an  example  which  demonstrates  that  the  mean  or  co- 
variance  may  not  exist.  Assume  that  the  probability  distribution  of 
the  amplitude  of  the  stochastic  coefficients  a^(t,w)  i6  Gaussian 
(normal).  The  normality  is  conserved  under  repeated  differentiation 

'k 

and  integration.  Hence,  in  computing  <  y(t,^)  >  or  <  y(t1>u)) 

yt(t2,u>)  >  by  averaging  the  infinite  series  term  by  term,  we  are 

computing  higher  and  higher  moments  of  a^(t,w).  Higher  moments  of 

the  zero  mean  Gaussian  random  variables  are  related  to  the  second 
2 

moment,  7  ,  by  the  following  expression  (Hiller,  1964): 

n 

<  7n  >  -  i‘"  <  y2  2  H  (0)  ,  (3.27a) 

n 

* 

Diacusaed  in  section  2. ft. 
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where  H^CC)  is  the  nt^  Hennite  polynomial  given  by 

n 

H  (0)  -  C2^'  n-  0,1,2,...  (3.  '7b) 

2n  2°  n! 

and 

H2n+i(0)  -  0  n-  0,1,2,...  (3.27c) 

Thus  Che  even  moments  -» »  36  n  -»  ®.  Because  of  tnis,  the  convergence 
of  the  averaged  series  requires  further  investigation.  The  terms  in 
the  averaged  series  are 

<  yQ(t,u>)  >  -  <  F(t,w)  > 


t 

<  y  (t,w)  >  -  /  <  <t>  ( t ,  T )  o(t,u))  >  v  F(t,w)  >  dr 

- o  -  - 

t 

-  /  <  >(t,T,w)  >  <.  F(t,w)  >  dr 

o 

(3.28) 

The  ensemble  averages  separate  in  (3.28)  because  of  the  statistical 
independence  of  a(r,w)  end  F(t,ui).  The  norm  of  the  general  even  term 

la 
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y2k(t*uj) 


C2k- 1 


>  (t ,  1 1 ) 


'<t2k-rt2k)  '  <  r<t2k'',>  >  dtf 


dc 


2k 


2k 

^  Tfio!  y(t*t!)  • 


"^t2k- 1  ’  C2k^  y  i!  1  *'  J  li 


2k 


2k-  1 


~  (2k)! 


<  M/k  >  J  j!  <  F(t,w)  >  jj  , 


(Z. 29) 


where  we  have  chosen  tor  the  norm  of  the  averaged  <n«trix  <  y  >  ard 
upper  bound  of  its  elements.  The  odd  mae>ents  vanish  because  element* 

7  are  zero  mean  Gaussian  processes.  Recall  that  y  is  an  n  x  n  matrix. 
For  Gaussian  random  variables,  we  have: 


<  M2'  >  -  <  m2  >k  ^ 

2kk! 


k  -  0,1,2, 


ind 


2k+i  .  n 

<  K  >  -  0 


k  -  0,1,2 . 


(3.30) 


where  <  a  >1*  the  upper  bound  of  mean  square*  of  the  eleaent*. 


I 

i 


Hence,  the  norm  of  the  general  term  of  the  Neumann  series  expansion  is: 
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The  inequality  (3.31)  means  that  the  averaged  Neumann  series  expansion 
converges  unitormly  ever,  if  the  stochastic  coefficient  matrix  consists 
of  Gaussian  random  variables.  Similar  analysis  may  be  applied  to  the 
Neianann  series  expansion  of  the  covariance  matrix  (3.22).  The  only 
term  that  presents  any  complications  in  the  analysis  is  the  last 
term  of  (3.22). 

Inapection  of  (3.21)  and  (3.22)  shews  that  for  calculation  ot 
the  second-order  statistics  of  Che  output  process,  knowledge  of  all 
the  moments  of  the  coefficients  is  required.  In  many  physical  problems, 
auch  complete  knowledge  is  lacking  or  it  is  diiticult  to  obtain.  In 
such  cases,  one  must  be  satistied  with  the  approximate  solution. 

However,  the  iterative  mathematical  approach  suggests  that  an  ‘terative 
approach  could  also  be  used  in  constructing  a  physical  model  One 
could  obtsin  exper  brent*  1  data  tor  computation  cf  the  meat  and  co¬ 
variance  of  the  stochastic  coefficients.  Then  "he  first  few  terms 
of  (3.21)  and  (3.22)  could  be  used  to  calculate  the  approx  lira  t  ions 
for  the  mean  and  covariance  of  y (t ,“0  which  could  be  compared  with 
experimental  result#.  It  the  agreement  between  calculated  and  experi¬ 
mental  result*  ia  unaat  isfactorv ,  more  complete  data  should  be  obtained 
on  the  stochastic  coefficients  and  the  procedure  should  be  iterated 
until  .he  results  become  adequace. 
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(If  the  stochastic  coefficients  are  Gaussian,  then  the  knowledge 
of  their  second-order  ratistics  Is  sufficient  for  complete  solution 
of  the  prob  leni.  ) 

In  the  solution  of  an  actual  problem,  the  Neumann  series 
expansion  becomes  quite  involved.  For  this  reason,  other  methods  of 
solution  are  investigated  in  th«_  following  sections.  The  advantages 
of  the  Neui.unn  series  expansion  are  that  it  is  more  generally  applicable 
than  other  methods,  sufficient  conditions  tor  convergence  are  known, 
and  it  provides  usetui  insight  to  the  nature  of  stochastic  Green's 
funct  ions . 

3 . 3  construction  of  Resolvent  Kernel  in  the  Case  of  a  Degenerate 

Integral  Equation 

The  construction  of  the  resolvent  kernel  by  means  of  the  Neumann 
series  expansion  is,  in  general,  laborious.  For  thi6  reason,  it  is 
desirable  to  investigate  other  methods  ot  solving  the  integral  equation 
(3.  lb).  Closed  iorm  solutions  to  the  Fredholm  and  Voiterra  integral 
equations  can  be  tound  it  these  equations  have  degenerate  Kernels 
(Courant  and  Hilbert,  19)3;  Hildebrand,  Hb2;  and  Kantorovich  and 
Krvlov,  L'fbd).  A  kernel  is  said  to  be  oe  gene  i  a  te  If  it  csn  be  rep¬ 
resented  in  the  term  ot  a  finite  sum  ot  products  of  function*  of  a 
•ingle  (deterministic)  variUK,e. 
n 

K(t.T.u)  -  I  c^(t)  b^(r,v*j)  n  <  oe  .  (3.32) 

k“  l 
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Such  representation  is  possible  if,  for  example,  the  Green's 
function  of  the  deterministic  part  of  the  differential  equation  (3.2) 
is  a  sum  of  exponentials.  The,  the  terms  in  (3.32)  are: 


Ck*k)  "  \  e5fp  f  sk  C  1 


(3.33a) 


and 


bk(t,u)  “  exp  [  -s^  r  ]  Qq(t,w)  ,  (3.33b) 

where  a^  and  are  complex  numbers.  Qq(t,w)  is  the  random  coefficient 
of  the  v  ■  0  term  in  (3.1).  By  considering  kernels  of  the  integral 
equation  which  can  be  represented  by  (3.32)  2nd  by  (3.33)  we  have 
lost  generality  in  two  ways: 

1)  An  exponential  solution  of  the  form  (3.32)  and  (3.33) 

Implies  that  the  deterministic  equation  is  time- invar iant . 

2)  The  form  of  b^T.u)  in  (3.33)  implies  that  only  Q0(T>UI) 
is  stochastic.  This  restriction  will  be  removed  later 
when  a  state  function  representation  of  equation  (3.2)  is 
con. idered . 

The  first  restriction  is  the  penalty  we  pay  for  the  simplification 
of  the  computation.  The  impulse  response  of  most  t ime- invariant 
linear  systems  consists  of  a  sum  of  exponentials  (Schultz  and  Melsa, 
1967).  Exceptional  cases  are  when  the  impulse  response  is  either  a 
constant,  t  or  an  exponential  times  t.  From  the  control  system  point 
of  view,  the  exponential  solutions  are  the  most  c_.*non.  Thus,  even 
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with  this  specialisation,  we  are  still  considering  an  Interesting 
case. 

Also,  representation  of  an  arbitrary  kernel  by  a  degenerate  kernel 
leads  to  a  useful  approximation  technique  This  will  be  discussed 
after  development  of  the  solution  for  degenerate  kernels. 

3 . 4  Single  Term  Degenerate  Kernel 

To  dnmonatrate  the  essential  ideas,  we  start  with  the  simple  case 
where  the  degenerate  kernel  consists  of  a  single  term.  The  integral 
equation  la 

t 

r 

y(t,w)  -  F(t,<*>)  +  X  J  Kft.r.w)  y(T,u>  dr  ,  (3.34a) 

o 

where 

K(t,T,w)  ■  c(t)  b(r,w)  .  (3.34b) 

The  functions  c(t)  and  b(r,u))  are 

c(t)  -  e8t 

and 

ST 


b(r,u)  •  e 


q(t,u>) 


(3.35) 
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where  a(r,w)  ig  the  randomly  time-varying  coefficient.  Note  that  the 
factor  c (t )  may  be  taken  outside  the  Integral  in  Equation  (3.34a)  and 
the  remaining  integral  ia  some  constant  independent  of  t.  Thus,  y(t,ui) 
must  be  of  the  form 


y(t,w)  -  F(t,u)  +  A(t,w)  c  (t)  , 


(3.36) 


where  A(t,w)  ia,  for  the  time  being,  an  unknown  random  process. 
Subatituting  Equation  (3.36)  into  Equation  (3.34),  we  obtain: 

c 

A(t,u>)  c(t)  ■  X  j  c(t)  b(T,u>)  F(r,u>)  dr 


w 

+  X  f  c (t )  b (t ,uj)  c(t)  A(t,uj)  dr 


J 

o 


(3.37) 


Solving  for  A(t,w),  we  have: 


A(t,w)  «  \  exp 


X  /  c(r)b(T,w)  /  exp[-Xc(o)  b(o,u>)  do]  F(T,(v)b(r,u>)  dT. 
L  J  1 

O 


J 

o 


(3.38) 


Subatituting  Equation  (3.38)  into  Equation  (3.36),  the  solution  of 
the  integral  equation  becomes: 

y(t,u)  -  F(t,u>) 


t 

r 

t 

T 

+  c(t)exp 

\  /  c (t )b (t ,u)dr 

J  CXP 

|  -K J  c(o)b(o,w)do 

F(T,w)b(r,u))  dr. 

(3.39) 


o 


o 


0 
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y(t,w)  =  F(t,uj) 


t  T 

+  c(t)  expj  X  J  c  (f)b  (t,w)<Jt  j  /  exp^-X  [  c  (o)b  (o,w)do  Jf  (t  ,w)b  (r,w>dr. 


J  /  eKpj_' 


(3.39) 


Using  Equation  (3.33),  and  recalling  that  X  ■  -1,  we  have 


y(t,w)  -  F(t,w) 


_  t 

exp!  -  f a(r,i*))dT 

l  J 

t 

r 

j 

(  /  a(o,w)do^  +  s(t-r) 

l 

a(r,w)F(T,w)  dr. 

u  vy  -j 

o 

o 

-  X  w  /  - 

0 

(3.40) 


In  Equations  (3.39)  and  (3.40),  the  resolvent  kernel  of  the  integral 
equation  (3.34)  can  be  Identified. 


r(t,T,w)  -  c(t)  oxp 


X  J  c(o)b(o,w)do 
o 


exp 


-X J  c(o)b(o,u>)dojb(r,w), 
o 

(3.41) 


or 


r  r 

♦ 

" 

-  (  a(o,w)  do 

exp 

/  a(o,w)  do 

..  J 

o 

lJ 

o 

a(T,w) 


j 

i 


(3.42) 
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If  a(T,w)  were  an  ordinary  function  of  time  instead  of  a  random 
function.  Equations  (3.39)  and  (3.40)  would  be  the  complete  solutions 
to  the  problem.  In  the  case  of  stochastic  coefficients,  we  are  still 
faced  with  the  difficult  problem  of  computing  the  statistical  measures 
of  y(t,<*>),  We  shall  investigate  the  computation  of  the  expected  value 
of  y(t,w)  first.  Averaging  Equation  (3.40),  we  have 


<  y(t,w)  >  *  <  F(t,w)  > 


-  <  exp 


a(r,w)dT 


t  t 

<•<  r 


I  exp  /  a(o,w)do  j  a(T,w)>  exp[s(t-r)]  <  F(r,w)>dT. 

J  L  J  j 

o  o 

(3.43) 


The  difficulty  ariaea  in  computing  Che  following  expected  value: 


<  exp 


J 


b  4.  r  T 

j  a(T,w)dT  [  expj  /  a (o,w)da 

J  <  L  o 


a(r,w)  > 


(3.44) 


This  expected  value  is  a  nonlinear  function  of  a(t,u>)  and  we  muat  resort 
aithar  to  nonlinear  transformation  techniques  or  power  series  expansion 
of  Equation  (3.44).  To  shorten  the  notation,  let 

t 

7(t,w)  -  j  a (t,w)  dt  . 

w 

o 


(3.45) 
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Then,  the  power  series  expansion  of  (3.43)  becomes: 

<  y(t,“)  >  - 


<  F<t,w)  > 


exp[s(t-T)]<  expO(t  ,w)-7(t,w)  ]  q(t,u»)  ><P(t,w)  >  dr 


<  F(t,w)  > 


t 

r  ■-  2 

J  exp[s(t-T)]  <  a(T,w)  [1  +  (7(T,w)-y(T,u))  +  j  (7(t,w)-7(t,w))  + 


•  •  +  T7  (7(T,w)-7(t,u)))n  >  <  F(t,w)  >  dr 

n . 


-  <  F(t,w)  > 


exp(s(t-T)  ] 


]Yjz  <a(T* 

n«0 


w)  f  7(T,w)-7(t  ,<*>)  ]  >  <F(r,U>)  >  dT  . 


(3.46) 


Conditions  for  the  convergence  of  the  power  series  expansion  (3.46)  can 
be  easily  established.  By  an  argument  similar  to  the  one  used  in 
section  3.2,  it  can  be  seen  that  (3.46)  converges  even  when  a(T»w) 
is  a  Gaussian  process.  The  first  two  terms  of  the  power  series 
expansion  are  quite  easy  to  compute: 
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O  r 

<  y(t,w)  >  *•  <  F(t,w)  >  -  /  exp  [s(t-r)]  <  a(T,w)  >  <  F(t,<*>)  >  dr 


C  T 

-  I  exp  [«(t-r)]  R  (t,o)  <  F(t,w)  >  dr  da 

J  J  CO 

o  o 


t  t 

+  /  I  exp  fs(t-r)]  R  (t,o)  <  F(t,w)  >  dT  do  . 

J  J  co 

n  o 


(3.47) 


(In  using  R  (r,o)  for  <  a^t1*1)  a(a,w)  >  we  have  implicitly  assumed 
CO 

that  a(T,w)  is  a  real  process.  This  assumption  i6  not  essential  and 
can  be  eaaily  removed  when  a(f ,<*>)  Is  a  complex  procesr.)  Of  course, 
if  a(T,w)  is  a  process  with  sero  mean,  the  integral  containing 
<  a(T,ui)  >  drops  out  and  the  approximation  becomes: 


<  y(t,w)  >  «•  <  F(t.ui) 


> .  I 


J 


exp  fs(t-T)]  R^(t,o)  <  F(t,u))  >  dr  do 


t  t 

+  I  /  exp  fs(t-r)]  R  (t,o)  <  F(r,u>)  >  dT  do 

vj  1  QO 

O  O 


(3.48) 


From  (3.47)  or  from  (3.48),  we  can  make  some  obaervat ions .  Fliat,  if 
<  F(t,w)  >  ■  0,  then  the  mean  of  the  solution  <  y(t,w)  -0.  On  the 
ocher  hand,  if  <  P(t,w)  >  4  0,  the  contribution  from  the  random 
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parameter  a(t,w)  does  not  vanish  even  if  <  ar(t,w)  >  *  0.  This  follows 
from  the  fact  that 


t  r 

ff 

o  o 


exp[a(t“t)]  R(r,o)  <  F(r,w)  >  dr  do  4 


t  t 


J  I 

O  0 


exp[a(t-T)  J  R(t,o)  <  FCTjOj)  >  dr  do 


(3.49) 


Similarly,  higher  order  terms  of  the  power  series  expansion  (3.46) 
also  contribute  to  the  mean  value  of  <  y(t,w)  >  . 

Next,  we  assume  that  F(t,w)  has  xero  mean.  Then,  the  auto- 
covariance  of  y(t,u>)  is  obtained  by  using  (3.40)  and  (3.45): 

Kyy (t i , t^ )  -  <  y(t1,u»)  y*(t2,w)  > 

-  ^FF(tl.t2) 

r1 

-  j  expfsft^T)]  <  exp[y(T,w)-y(t1>to)]a(T,u))  >  RrF(T,t2)dr 
o 

•*pfs(t2-r)]  <  expfy(T,w)-y(t2,w)]  a  (r,w)  >  RFp(t1 ,r)dT 


o 


o 
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*1  r2 


♦  f  J «P[»(tl-T>-«*(t2-o)] 


o  o 


<  «P{[7CT,u»)-7(tl,u)]  +  [7(0.u))-7(t  u») ]*}  a(T,u>)  a*(o,u))  > 


Ryy(T,o)  dT  do 

(3.50) 

Tht  two  center  tern*  can  be  expanded  in  the  same  manner  as  in  (3.46). 
An  analogoua  expanaion  of  the  laat  term  can  alao  be  made. 


<  «P([7(T,u)-7(t1,u»)]  ♦  f7(o.w)-7(t2,u.)]*)a(T.w)  a*(o,u»)  > 

-  <  a(r,u)a*(o.w){l  +  [7(T,w)-7(t1,u)]  +  [7(0, W)  -  7(t2,w)]# 

+  2  '  7( tj.u)  +  7*(o,w)  -  7*(t2,w)]2  .  .  . 

♦  nT  ‘  7(t ^ ,<*>)  +  7  (o.w)  -  7*(t2,u))]n  ...  > 

m 

\  l  *  *  * 

“  /  nT  <  (o.w)[7(t,w)  -  7(tlt«)  +  7  (0,w)  -  7  (,„))”  > 

n-0 


.) 


(3.51) 


j 
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The  expansion  involves  higher  tnd  higher  moments  of  a(t»u)  but  does 
not  involve  repeated  integration  as  the  Neumann  series  expansion  does. 
The  power  series  expansion  (3.51)  demonstrates  that  knowledge  of  all 
the  moments  of  stochastic  coefficient  n(ttia)  is  required  for  computation 
of  the  correlation  function  R  (tj.tj).  We  must  compute  the  moments 


<  a(T,w)  a  (o,w)0(T,u)  -  r (t t +  r*(o,w)  -  7*(t2,w)]n  >  , 


where  7*s  are  given  by  (3.45) .  Obviously, 


<  a(T,w)  a  (o,u>)f  7(t,w)  -  7(t  ^  ,w)  +  7*(o,w)  -  7*(t2>uj)]n  > 
f<a(T,u)a  (o,u»)  ><  f7(T,u»)  -  7  ( t  L ,  w)  +  7"(o,w)  -  7*  ( 1 2 , w)  1° 


(3.52) 

it  Clt  ( t ,  <*»)  is  a  Gaussian  process,  then  the  higher  moments  of  the 
process  can  be  computed  from  the  second-order  statistics.  Hence, 
a  complete  solution  can  be  obtained  from  the  knowledge  of  the  second- 
order  statistics. 

II  rt(t,u>)  is  a  process  with  tero  mean,  the  simplest  approx  imation 
^  which  atill  takra  into  account  the  stochastic  coefficient. 

Is  obtained  by  disregarding  all  bu^  the  first  terms  in  Che  power  series 
expansion  of  (3.50) 


vw '  wv  * 


'  i  h 


-r)-s  (t  -t)]  R  (r ,o)R_(T,o)drdo 
*■  *  ("n  *  * 


l 

ii! 

i  Ct 


4  / 


(3.53) 
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★ 

3.5  n-Tenn  Degenerate  Kernel 

In  this  section,  the  Integral  equation 

t 

y(t,w)  -  F(t,w)  +  X  /  K(t,T,w)  y(r,u>)  dt 

J 

o 

with  the  kernel 

n 

K(t,T,i»))  -  ]T  ck(t)  bk(T.w) 
k-1 

is  investigated.  We  assume  a  solution  of  the  form 


y(t,ui)  -  F (t,w)  +  £  ct 


(C) 


i-1 


Substituting  (3-540  into  (3  54a),  ve  get 


t  n 


At  ct(c)  -  X  f  ck(0  bk(T»w>  1  F(T.^ 


i-1 


k-1 


t  n 


+  X 


o  k-1 


£  ‘k(t)  bk(»,“)  j  I  Aj  «,  <’)  «' 


)■! 


* 

Chapter  II,  Kantorovich 


«irvd  Krylov  (  1958) 


(3.54a) 


(3.54b) 


(3.54c) 


dT 


(3.55) 
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fly  equating  the  coefficients  of  c^(t),  we  obtain 
integral  equations  for  the  unknowns  A^: 


A 


i 


n  t 

A  ^  [  Aj  blvT*w)  c  (t)  dT 

j-1  o 


^(t.w)  F(t,w)  dr 


(i  -  1.2, 


■n) 


To  simplify  algebra  let: 


b i tT .“*>  c)(,)  ■  “u 


and 


t 

n 

j  b^T.w)  F(t,u)  dT  -  ff 

O 


With  thi§  notation,  the  simultaneous  equations  (3 
written  £•: 


t  n 


\  • x 


I  <*/,)> 


0  J*l 


( i  •  1.2, 


n  simultaneous 


(3.56) 


(3.57a) 


(3.57b) 


.56)  can  be 


.  . . .n) 


(3.58) 
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which  can  be  expressed  in  Che  matrix  form  as: 
t 

r 

A  -  \  /  B  A  dr  »  Xf  (3.59) 

o 

To  find  the  unknown  functions  A^,  we  oust  solve  the  matrix  integral 
Equation  (3.59).  Because  the  integral  Equation  (3.54a)  is  a  special 
case  cf  the  more  general  matrix  formulation  of  the  problem,  the 
discussion  of  further  details  of  the  solution  are  postponed  until 
the  next  section. 

3.6  Stste  Function  Formulation 

State  function  formulation  has  been  widely  used  in  modern  control 
system  theory  and  in  formulation  of  Lagrange's  equations  in  classical 
mechar-fcs.  For  a  system  that  may  be  represented  by  l*  'ee~  differential 
equations,  the  atate  apace  equations  are 

y(t,u>)  -  a(t,w)  y(t,u)  +  U  ui  ,u>)  ,  (3.60) 


where  y(t,w)  is  an  n-dimenalona l  atate  vector,  a(t,w)  an  n  x  n  system 
matrix,  U  is  an  n  x  r  control  matrix  and  u(t,u>)  is  an  r*o intensions! 
control  vector.  Here,  the  terminology  of  control  system  theory  has 
been  used.  General  mathematical  terminology  or  terminology  from 
classical  mechanics  could  have  been  used  equally  well. 

Let  each  member  of  the  system  matrix  be  separable  in  a  determin¬ 
istic  term  and  a  random  term.  In  particular,  let  the  members  of  the 
system  matrix  be  of  the  form 
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(3-61) 


where  R  is  a  constant  and  the  a^j(t,w)  are  stochastic  processes. 
Because  R  ie  assumed  to  be  a  constant,  the  deterministic  part  of 
(3.60)  io  a  linear  time* invariant  differential  equation.  The  solution 
to  the  deterministic  differential  equation  can  be  expressed  in  terms 
of  the  state  transition  i  ttrix  $(t).  The  methods  of  construction  of 
the  state  transition  matrices  (Six's)  for  linear  t ime- invariant  systems 
are  discussed  in  several  texts  on  control  system  theory  (Schulte  and 
Melaa,  1967;  Zadeh  and  Desoer,  1963;  and  De  Russo,  Roy  and  Close,  1963). 
Therefore,  it  i6  assumed  that  the  state  transition  matrix  for  the 
deterministic  part  of  the  state  space  equation  (3.60)  is  known.  Using 
the  state  transition  matrices,  the  state  apace  equations  can  be  con¬ 
verted  into  a  matrix  integral  equation 


t 

y(t,w)  -  F(t,w)  +  \  j  X(t,T,<*>)  y(T,w)  dT  ,  (3.62) 

o 

where  y(t,u)  and  F(t,w^  are  n-dimensional  vectors  and  K{t,r,u»)  is  an 
n  x  n  matrix.  F(t,w)  is  the  solution  of  the  deterministic*  part  (part 
with  deterministic  coefficients)  of  the  state  space  equation*.  The 
kernel  of  the  integral  equation  is 


K(t,T,m)  -  «t> < c - t )  a(T,ui) 


(3.63) 
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All  the  matrices  in  (3.73)  are  n  x  n  matrices, 
state  transition  matrix.  For  linear  time- invar iant 
equations,  the  state  transition  matrix  <t> ( t )  has  the 
properties  (Schulte  and  Melsa,  1967): 

1)  It  is  nonsingula*'  for  all  finite  values  of 

2)  «.(tx)  $<t2)  -  •<t1  +  t2) 

3)  •(t)“l  -  *(-t) 

4)  $(t)n  *  <J> (nt )  . 


<&(t"T)  ia  the 
differential 
following  useful 

t. 


(3.64) 


Using  the  second  property,  the  kernel  of  the  integral  equation  becomes 


K(t,T,u)  -  $(t- t)  «(t,w) 

-  $(t)  4>(-t)  a(T,w) 

-  $(t)  b (t ,w)  ,  (3.63) 

Vre,  for  simplicity,  the  product  $(-t)  a(t,iv)  is  denoted  by  b(r,u)). 
Now,  the  integral  equation  (3.62)  has  a  degenerate  ker"'*i  and  can  be 
solved  by  assuming  a  solution  of  the  following  form: 

y(t,w)  •  F(t,w)  +  ®(t)  A(t,w)  ,  (3.66) 

where  A(t,w)  is  an  n-dimensional  vector.  Substituting  Equation  (3.66) 


into  Equation  (3.62),  we  have; 
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t 

®(t)  A(t,w)  -  X  I  $(t)  b(r,w)  F(t,u>)  <Jt 

-i.  ■  .  ‘.j  — ■ .  —  —  — — — 

o 


t 

+  X  /  4>(t)  b(t,w)  ®(t)  A(t,w)  dr.  (3.67) 

o 


-1  -1 

Premultiplying  both  sides  of  Equation  (3.67)  by  ♦  (t)  [$>  (t) 

exists  according  tc  the  first  property  of  Equation  (3.64)]  and 
rearranging  gives 


f 

l 


A(t,w)  -  X 


b (t ,i*j)  $(t)  A(t,w)  dt 


I 


X  /  b(T,w)  F(r,w)  dT. 


(3.68) 


This  matrix  Integral  equation  must  be  solved  for  A(t,u>).  This  can  be 


done  by  again  using  Neumann  series  expansion;  i.e.. 


A(t,w) 


00 


Z 


A  (t,u) 
— £2 _ 


(3.69) 


where  the  A  (t,w)  terms  are  given  by  the  following  iterative  aolution: 
n 


AQ(t,w)  »  /  b(T,u»)  F(t,w)  dt 


(3.70a) 
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and 

t 

Aj(t,w)  -  I  b(T5u>)  $(t)  Aq(t,w)  dr 
c 

t  t 

+  /  j  b(r,u>)  <J.(T)  b(o,u>)  F(o,u>)  dr  da  ,  (3.70b) 

o  o 

or,  in  general, 

t 

A  (t,w)  ■  /  b(r,w)  #{t)  A  ,(t,w)  dT.  (3.70c) 

t>  J  _____  ___  n- 1 

o 

Sufficient  conditions  for  the  convergence  of  the  Neumann  series  (3.69) 
a*.e  given  by  Theorem  1  of  section  3.2. 

Using  (3.66),  the  expected  value  of  y(t,u>)  is: 


<  y(t,w)  >  ■  <  F(t,u)  >  +  $(t)  <  A(t,w)  > 

00 

-  <  F(t,ui)  >  +  <f(t)  ]T  <  An(t,u)  >  , 

n»  0 

where  A  (t,w)  is  given  by  iterative  integrals  (3.70a),  (3.70b) 
n 

and  (3.70c).  Here  again,  it  can  be  observed  that  if  <  F(t,<*»)  >  4  0. 

<  y(t,w)  >  does  not  necessarily  vanish  when  <  o(t,w)  >  ■  0  because 

expressions  for  <  A  (t,u>)  >  contain  higher  moments  of  a(t,w)  which 
n  _ 

may  not  vanish.  The  first  two  termj  in  the  Neumann  series,  A^(t,u)) 
and  A^(t,u),  can  be  computed  from  the  second-order  statistics;  for 
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higher  order  terms,  we  need  more  complete  statistical  knowledge  of  the 
stochastic  parameter  matrix  a(t,w).  For  the  approximation  which  uses 
the  second-order  statistics  of  the  stochastic  parameters,  we  have: 


<  y(t»w)  >  «s  <  F(t,u>)  >  + 


$(t-r)  <  a(r,w)  >  <  F(t,w)  >  dT 


o 


+ 


t  T 


O  O 


4>(t-T)  <  a(T,w)  #(t -a)  a(o,w)  >  <  F(o,t*>)  >  dtdo. 


(3.71a) 


If  the  coefficient  matrix  a(r,u>j  has  zero  mean;  i.e., 


<  a(r,u)  >  *  0  , 


then,  (3.71a)  simplifies  further  and  it  becomes: 


<  y(t,u)  >  *=  <  F(t,ui)  > 


t  r 

+  J  J  *(t-r)  <  Q(t,w)  $(t-o)  a(o,ut)  >  <  F(o,w)  >  dTdo. 

o  o 


(3.71b) 


The  Equation  (3.71b)  demonstrates  how  the  mean  value  of  y(c,w) 
depends  on  the  second  moments  of  the  coefficient  matrix.  Of  course, 
in  this  approximation,  we  neglected  the  functions  which  contain  higher 
moments  of  the  coefficient  matrix. 


»<*»!*  tWMfrttW 


The  expression  for  Che  covariance  matrix  is  obtained  by  post- 
multiplying  y(t^ut)  by  the  complex  conjugate  transpose  of  y(t2>w) 
(hermetlan  conjugate  denoted  by  f)  and  averaging;  i.e.; 


R  yCtj.tj)  -  <  yCtj.w)  yT(t2,w)  > 


-  <  F (t^,w))  +  ♦<t1)  A(tlfw))(F(t2,-))  +  4>(t2)  A(t2,w))f  > 


-  <  F(trw)  F^Ctj.w)  >  +  <  ♦(t^  A(tru))  Ft(t2.w)  > 


+  <  F (t^.w)  A+(t2,w)  «tf(t2)  > 


+  <  ♦(tj)  ACtj.w)  A+(t2,w)  ®t(t2) 


-  RFp(tl»t2)  +  «(tl)<  A(cltw)  F+(t2,u>)  > 


+  <  F(t1(w)  A+(t2,w)  >  ^(tj) 


+  ♦(tl)  <  A(tltu))  A+(t2,w)  >  ♦t(t2) 


(3.72) 
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If  only  the  first  terms  of  the  power  series  expansions  are  used,  an 
approximate  expression  for  the  covariance  matrix  R  (t.»t.)  is 

yy  *  ^ 


R 

yy 


RFF(tl,t2) 


t 

+  Mtj)  f  «  l(t)  <a(T,w)  >  RFF(Ti't2'>  dT 
-  o  -  -  - 


<  a'(T,w)  > 


♦  1  (t) 


dr 


*+(t2) 


+  •  (tj) 


r'l 


r2  -l 

/  «  (T) 


R  2r.2(T»o)  ® 
a  f 


-r 


(o)  dt  do 


*f(t2) 


(3.73a) 


where 


Ra2p2(T*°^  *  <  (a(Tiw)  F(t,u))}  (a(o,<*>)  F(o,w)]^  >  (3.73b) 


The  approximate  expression  for  R  (t^.t^)  simplifies  further  if 


<  a(T,w)  >  -  <  aT(r,w)  >  -  0  . 


Then,  (3.73a)  becomes: 


R  r^ti,t2^  **  RFF^tl,t2^  + 


yy 


C1  r  2 


+  ♦(tjj  f  j  /  *  1(t)  Rcf2p2(T,o)  ♦  1  (o)  dT  do  J  *^(t2)  . 


j  J 

o  o 


(3.74) 
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The  equation  (3.74)  also  shows  some  Interesting  results.  The  first 
ten  in  (3.74)  is  the  contribution  of  the  deterministic  part  of  the 
differential  equation.  The  next  term  is  the  simplest  term  which  takes 
into  account  the  randomness  of  the  coefficients.  To  compute  additional 
terms  in  the  expansion,  we  need  to  know  the  higher  moments  of  the 
coefficients.  If  only  the  second-order  statistics  of  the  coefficients 
are  known,  (3.74)  is  at  far  as  we  can  go  without  additional  knowledge. 

In  the  state  space  formulation,  one  has  considerable  freedom  in 
the  selection  of  the  coefficient  matrix  representation.  The  evaluation 
of  the  truncation  error  is  greatly  simplified  if  one  can  select  a 
representation  for  the  coefficient  matrix  which  will  make  the  Neumann 
series  expansion  of  A(t,w)  an  alternating  series.  Then,  for  a  conver¬ 
gent  series,  the  truncation  error  is  smaller  than  the  first  term 
neglected,  provided  the  norm  of  each  term  is  smaller  than  the  norm 
of  its  preceding  term. 

3.7  General  Remarks 

In  using  the  degenerate  kernel  approach  for  solving  the  Volterra 
Integral  equation,  we  still  have  to  resort  to  Neumann  series  expansion. 
From  the  standpoint  of  computational  difficulty,  there  is  no  essential 
difference  between  the  straight  Neumann  series  expansion  and  the 
degenerate  kernel  approach.  Selection  of  the  method  depends  on  the 
physical  problem  end  computational  convenience.  For  example,  in  the 
study  of  wave  propagation  in  random  media,  iterative  integrals  of  the 
Neumann  aeries  expansion  have  the  convenient  Interpretation  of 
repeated  scattering  of  waves.  On  the  other  hand,  in  the  case  of  s 
control  system  problem,  the  deterministic  transition  matrix  may  be 
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already  known  and,  therefore,  the  degenerate  Kernel  method  may  be 
convenient.  Both  methods  of  solution  converge  under  the  same  general 
conditions.  Hence,  we  have  lwo  complementary  methods  for  solving  the 
stochastic  Volterra  integral  equations.  Other  methods,  such  as  the 
Fredholm  method  and  the  Hi lber t-Schmid t  method,  do  not  offer  any 
computational  advantages.  To  use  the  Hi lber t - Schm id t  method,  one  has 
to  solve  a  pair  of  first  kind  integral  equations.  This  problem  is  no 
easier  than  solving  an  integral  equation  of  the  second  kind.  Fredholm 
theory  ha6  been  very  important  in  the  development  of  the  classical 
integral  equation  theor>  ,  but  to  use-  the  Fredholm  method  for  construe* 
tion  of  the  resolvent  kernel  is  prohibitively  difficult  in  practice. 

Many  aribtrary  kernels  can  be  approximated  by  the  degenerate 

kernels.  A  Taylor  aeries  expansion  of  an  arbitrary  kernel  can  be  ueed 

for  approximat ing  It  with  a  degenerate  kernel.  For  example,  a  kernel 

sin  (t  t)  can  be  approximated  by 

3  3  5  5 

sin  (t  t)  «=  t  r  -  — “ —  +  ■■  ;  .  '3.75) 

3'.  5- 

A  Fourier  aeries  expansion  of  the  arbitrary  kernel  or  special  Inter¬ 
polation  devices  can  also  be  used  The  use  of  the  method  of  moments 
for  solving  integral  equation  is  equivalent  to  the  replacement  of  an 
arbitrary  kernel  by  a  degenerate  kernel.  In  the  cage  of  deterministic 
integral  equations,  the  estimate*  oi  errors  caused  by  the  replacement 
of  a  given  kernel  by  a  degenerate  one  are  known.  Okie  auch  theorem, 

•  lightly  modified  tor  atociiastic  application,  is  stated  below 
(Kantorovich  and  Krylov,  1958). 
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Theorem  2  .  Let  there  be  two  kernels,  k(t,r,w)  and  K(t,T,^)  and  let 
it  be  known  that 


!*(«-. t,w) 


k(t,T,w)  |  dr  <  h 


(3.16) 


t 

o 


almost  everywhere  P  (a.e.P.),  and  that  "be  resolvent  kernel  >(t,T,ui,\) 
of  the  equation  with  kernel  k(t,T,w)  satisfies  the  inequality  a.e.P. 

r 1 

j  ir(t,T,w,X) |  dr  <  B  (3.77) 

t 

o 

and  also  that 


|f(t)  -  f L (t ) f  <  q  a.e.P. 


(3.78) 


Then,  if  the  following  condition  is  satisfied  a.e.P.: 


1  -  |\|  h ( 1  +  |X|  B)  >  0 


(3.79) 


the  equation 

cl 

K(t,r,w)  dr  -  f(t,w) 

t 

o 


y(t,w)  -  ^ 


(3.80) 
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has  a  unique  solution  y (t,<u)  a.e.P.,  and  che  difference  between  this 
solution  and  the  solution  >\t,uj)  of  the  equation 


y(t,u>)  -  X.  /  k(t,T,u))  y(T,u>)  dr  -  f^r.w) 

t 

o 


"'.81) 


is  smaller  a.e.P.  than 


| y  Ct  ,ui) 


y(t," )  |  < 


N|\l  h(l  +  Ixj  B)2 
1  -  f X I  h  (1  +  f\|  B 


+ 


n  a  +  |x|  b). 


(3.82) 


where  N  is  the  upper  bound  of  |f(t,u»)|  a.e.P. 

Proof  is  a  trivial  mod i f ica t ion  of  the  deterministic  proof  given 
by  Kantorovich  and  Krylov  (1958).  The  theorem  is  less  than  satisfactory 
for  many  interesting  processes;  however,  the  hypotheses  of  the  theorem 
are  too  restrictive  and  the  conclusion  ot  the  theorem  should  give  the 
mean  square  anprox ima t ion  error.  To  make  the  above  theorem  applicable 
to  the  Volterra  integral,  we  define  the  Volterra  kernels  as  follows: 


K  (t.r,^)  -  K(t,T,ul)  T  V  t 

v 

•  0  t  _>  t  (  ‘  .62) 

3 . 8  Cone  lug  loin- 

I'M*  chanter  presents  two  methods  for  obtaining  expressions  for 
che  ensemble  average  and  covariance  of  the  solution  ot  an  n  order 
dif ierent  ia  1  equation  with  stochastic  coe 1 1  lc  ienc s  .  In  both  cases,  it 


is  assumed  tiiat  the  coefficients  of  the  differential  equation  are 


j 

i 

i 

I 

I 
! 


) 


i 

i 
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separable  into  deterministic  and  stochastic  coefficients.  T'e 
problem  now  becomes  a  problem  of  solving  a  Volterra  integral  equation 
Wi.n  a  stochastic  kernel.  In  the  first  method,  the  problem  is  solved 
by  the  Neumann  series  expansion.  The  Neumann  series  expansion  is  a 
aeries  of  iterated  integrals.  A  previously  computed  term  is  used 
to  compute  higher  ordet  terms.  Sufficient  conditions  for  the  conver¬ 
gence  of  the  Neumann  series  a-e  given.  The  Neumann  series  is  used 
to  find  the  resolvent  kernel  of  the  stochastic  integral  equation.  The 
ensemble  averages  and  covariance  functions  of  the  solution  are  expressed 
in  terms  of  the  resolvent  kernel  and  the  corresponding  statistical 
measures  cf  the  input  process.  The  kernels  of  tnese  integral  expressions 
for  the  statistical  measures  of  the  solution  can  be  interpreted  as  the 
stochastic  Green's  f  ction8. 

In  the  second  method,  it  is  assumed  that  the  deterministic  part  of 
the  differential  equation  is  time  invariant.  Then,  in  many  case*,  the 
kernels  of  the  integral  equation  are  degenerate  kernels.  In  these  cases, 
we  have  a  slightly  different  method  for  solvinj  the  Volterra  integral 
equation.  We  still  have  to  resort  to  Neumann  series  expansion  for  the 
complete  solution  of  the  integral  equation.  From  the  standpoint  of 
computational  difficulty  and  convergence  of  the  solution,  there  is  no 
escential  difference  ^ tween  the  two  methods. 

However,  we  have  two  complementary  methods  of  solving  the  problem. 

Applying  these  methods  to  some  very  simple  equations  and  Just  computing 
the  first  couple  terms  of  the  expansion,  •■e  are  able  to  observe  some 
Interesting  results.  Even  if  the  stochastic  coefficients  have  zero 

i 


mean,  the<r  contribution  to  the  mean  value  of  the  solution  does  not 
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vanish.  This  demonstrates  that  the  average  of  the  solution  of  a 
differential  equation  with  stochastic  coet' f icfe^ts  is  not  necessarily 
the  same  as  the  solution  of  the  averaged  equation.  Both  methods  of 
solution  also  show  thut  expressions  for  the  second-order  statistics 
of  the  solution  of  linear  stochastic  differential  equations  requires 
knowledge  of  all  the  moments  oi  stochastic  coefficients.  An  excep¬ 
tional  case  is  that  in  which  the  stochastic  coefficients  are 
Gaussian  processes.  Then,  the  knowledge  of  th^  6econd-order  statistics 
is  sufficient  for  the  complete  solution. 

In  both  cases,  the  computation  is  simplified  if  the  state  space 
formulation  is  used.  The  use  o.f  the  state  space  formulation  haa  the 
further  advantage  that  it  connects  modern  control  system  theory  with 
this  work. 

The  concepts  developed  in  this  chanter  will  be  generalised  in  the 
next  chapter  to  partial  differential  equations  and  applied  to  the 
propagation  of  the  scalar  wave  function  in  a  randomly  time-varying 
mtd ium. 


CHAPTER  IV 


WAVE  PROPAGATION  IN  A  RANDOMLY  TIME 
AND  SPACE  VARYING  MEDIUM 

4 . 1  Introduction 

The  problem  of  propagation  of  an  electromagnetic  wave  in  a 

•k 

random  continuous  media  has  been  studied  extensively  by  many  workers; 
however,  in  almost  all  cases,  attention  has  been  limited  to  a  random 
medium  with  space-varying  statistical  properties.  In  these  studies, 
a  so-called  "quas imonochroma t ic"  solution  has  been  assumed.  This 
quasimonochroma  tic  assumption  essentially  neglects  the  time-varying 
properties  of  the  meuium.  In  many  cases,  this  assumption  may  very 
well  be  correct,  for  example,  in  the  case  of  the  propagation  of  light 
through  frosted  glass.  In  cases  when  one  deals  with  wave  propagation 
through  hot  or  very  energetic  media  such  as  the  atmospheres  of  stars 
or  plasmas,  the  quasimoitochromatic  assumption  is  clearly  incorrect. 

In  other  cases,  such  as  in  the  study  of  synchronization  of  spatially 
separated  frequency  standards,  doppler  broadening  of  radar  signals 
or  interaction  of  two  signs  la  in  a  nonlinear  medium,  the  small  fre¬ 
quency  shifts  caused  by  the  randomly  time-varying  medium  may  be  the 
important  questions  under  study.  Tn  all  cases,  the  validity  of  the 
quasimonochromaticity  assumption  should  be  verified. 


See  the  references  in  section  1.3. 

** 


One  assumes  that  the  solution  of  the  wave  equation  is  essentially  a 
sinusoid  at  a  single  frequency,  if  the  source  is  a  sinusoid  at  a 
•ingle  frequency. 


It  is  assumed  that  the  dielectric  permittivity  e(t,P,w)  is  a 
random  function  of  time  t  and  position  P.  It  i#  further  assumed  that 
it  can  he  separated  into  a  constant  term  eQ  plus  a  randomly  space- 
and  time-varying  term.  The  wave  equation  (4.1)  for  the  electric  field 

E  can  be  derived  from  the  pair  of  Maxwell's  equations  that  connect  the 

* 

electric  and  magnetic  fields 

+  (ii_eE)  “  -  u  M  >  (4-1) 

at*  °  °  at 

where  J  is  the  current  density. 

Xi>  the  quaeimonochromatic  assumption,  it  is  assumed  that 

^7  (i  el  *>  u  c  b-z  i  ,  (4.2a) 

bt  °  °  dt 

and  that  the  equation  (4.1)  can  b  vritten,  in  the  current  free 
region , 

—  2  — 

VxVxE  -su  eE  *0  ,  (4.2b) 

o  o  o 

■*  -  (of 

where  E  •  E  e 
o 

These  assumptions  are  avoided  in  this  dissertation.  Instead,  it 
is  assumed  that  the  special  gradient  of  the  dielectric  permittivity 
over  the  distance  of  one  wavelength  is  small: 

_ 

An  overbar  -  denotes  vectors. 
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It  is  assumed  that  the  dielectric  permittivity  e(t,P,u)  is  a 
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it  can  be  separated  into  a  constant  term  €q  plus  a  randomly  space- 
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electric  and  magnetic  fields 

V  x  V  x  E  +  (ucE)  -  “  u  ^  ,  (4.1) 

at2  °  ° 

where  J  is  the  current  density. 

In  the  qussimonochf'matic  assumption,  it  is  assumed  that 


u  eE  «  u  c 
n  o 


(4.2a) 


and  that  the  equation  (4.1)  can  be  written,  in  the  current  free 
region, 

V  x  V  x  E  -  s2u  eE  ■  0  ,  (4.2b) 

o  *0  o 
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o 
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X/ €  «  1  . 


(4.3) 


Than,  (4.1)  becomes  the  following  wave  equation 


v2!-  < 


St 


2 


u  cE  -  M, 


M 

o  at  * 


(4.4) 


To  keep  the  basic  problem  uncluttered  of  nonessentlsl  mathematical 
complexify,  we  restrict  the  analysis  to  the  solution  of  the  following 
scalar  wave  equation: 


V2y(t,r,w)  -  (  2  +  a(t,r,u>))y(t,r,w)  -  x(t„r,u>) 

St 


(4.5) 


-  3  - 

ttT,  rcR  ana  on  the  probability  space  (fl,X,P).  a(t,r,u>)  is 

*  stochastic  coefficient;  that  is,  a  random  function  of  both  time 

and  apace.  x(t,r,w)  is  the  stocnastic  source  term.  The  source 

term  could  be  a  deterministic  function  but,  for  greater  generality, 

it  is  assumed  to  be  stochastic.  It  is  assumed  that  the  source  term 

x(t,r,<»>)  and  the  coefficient  a(t,r,w)  are  statistically  independent, 

For  simplicity,  it  is  assumed  that  a(t.r,w)  is  a  real  stochastic  process. 

In  order  to  be  able  to  u^e  some  of  the  results  from  the  theory  of  wide- 

sense  stationary  stochastic  processes,  It  is  assumed  that  both 

a(t,r,i»)  and  x(t,r,uj  are  wide-sense  stationary  or  reducible  to 

★ 

wide-sense  stationary  stochastic  processes.  This  assumption 


Discussed  in  section  2.4. 


simplifies  the  development  in  that  the  spectral  representations  of 
a(t,r,oj)  and  x(t,r,w)  have  some  useful  properties.  Wide-sense 
stationarity  only  in  time  t  is  required.  It  is  not  required  that 
a(t,r,ia)  and  x(t,r,w)  are  wide-sense  stationary  in  their  special 
vi'  iable  r.  The  statistical  properties  of  a(t,r,u)  and  x(t,r,w)  may 
change  in  an  arbitrary  manner  in  the  special  variable  as  long  as 
a(t,  r ,w)  and  x(t,r  ,<a)  renta  in  second-order  processes  and  (4.3)  remains 
satisfied.  By  placing  no  overly  restrictive  conditions  on  the  spacial 
statistics  01  the  medium,  physical  reality  is  maintained.  The 
statistical  properties  of  the  medium  may  vary  in  space  in  a  manner 
that  accommodates  the  usual  physical  problems.  The  randomness  of  the 
medium  may  be  restricted  to  be  in  a  given  volume,  shown  by  Figure  4.J., 
or  the  mean  square  amplitude  of  the  fluctuation  of  a(t,r,w)  may  vary 
with  height  as  it  is  common  in  the  tropospheric  communication  problems. 
The  reducibility  to  wide-sense  stationarity  also  allows  us  to  consider 
physically  reasonable  problems.  The  sample  functions  of  or(t,r,w)  and 
x(t,r,w)  fluctuate  rapidly  in  time,  but  their  averaged  properties  vary 
slowly  with  time.  It  is  rapid  time  fluctuation  of  the  sample  function 
a  (t.r  ,w)  which  makes  the  qua6imonochromatic  assumption  dubious.  The 
concept  of  reducibility  to  stationarity  permits  slow  variation  of  the 
statistical  properties  of  a(tir,w)  and  x(t,r,<*t).  These  slow  variations 
of  the  statist'cal  properties  must  be  sufficiently  slow  so  that  they  do 
not  mask  the  spectral  spreading  which  is  caused  by  the  rapid  time 
v^riatlon  of  the  sample  function  a(t»t»UJ)*  This  condition  is  satisfied 
if  the  power  spectrum  of  the  function  which  modulates  the  statistical 
properties  of  a(t,r,w)  an<*  x(t,r,w)  contains  only  frequencies  which 
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are  very  much  lower  chan  the  significant  frequencies  of  these 
stochastic  processes.  In  future  work.,  it  would  be  desirable  to 
remove  even  the  wide-sense  stationarity  assumption. 

The  use  of  a  scalar  wave  equation  also  limits  the  ,en«_ra*.it  of 
the  analysis.  It  neglects  the  change  in  polarization  due  to  >  random 
medium,  and  it  is  strictly  applicable  only  to  the  forward  scattering 
of  electromagnetic  waves.  Of  course,  in  case  of  sound  propagation, 
there  is  no  loss  of  generality  when  a  scalar  wave  equation  Is  used. 

The  statistical  measures  f  interest  in  this  chapter  are  the 
power  spectral  density  an'  c  iercnce  functions  of  the  scalar  wave 
function  y(t,r,4i).  The  exp  sr  ons  for  the  spectral  density  w'li 
reveal  the  spectral  spreading  caused  by  a  randomly  t l.ne-vary ing 
medium.  Coherence  functions  have  been  found  useful  in  statistical 
optics  (Born  and  Wolf,  1964;  Beran  and  Parrent,  1964;  O’Keili,  1963; 
and  Mandel  and  Wolf,  1965)  and  more  recently  in  general  electromagnetic 
theory  (Special  Issue  on  Partial  Coherence,  1967).  To  so  ,e  our  prob¬ 
lem,  the  differential  equation  (4.5)  is  converted  into  a  d  i  f l “rent ia  1 
equation  for  the  spectral  representations  of  y(t,r,w),  then  the 
methods  of  Chspter  III  are  applied.  Both  the  Neumann  serit^  expansion 
and  degenerate  kernel  approximations  are  investigated. 

4 . 2  Spectral  Represent ; t Ion  of  the  Sea  la t  Wave  Equation 

In  principle,  it  is  possible  to  apply  tne  Neumann  series  solution 
of  section  3.2  directly  to  the  scalar  wave  equation  (4.5)  but,  after 
the  first  few  iterations,  the  time-domain  expressions  become  unmanage¬ 
able  and  difficult  to  interpret.  Furthermore,  the  interesting  statis¬ 
tical  measure  in  this  case  is  the  power  spectrum  of  thv  scalar  wave 
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function.  Other  second-order  statistical  measures  such  as  variance 
and  mutual  coherence  functions  can  be  obtained  by  taking  the  inverse 
Fourier  transform  of  the  power  spectrum.  Because  there  ia  a  simple 
relation  between  6pectral  representation  of  a  random  variable  and  the 
power  spectrum  (Chapter  II),  equation  (4.5)  is  solved  for  the  spectral 
representation  of  y(t,r,u»).  The  spectral  representation  is  also  called 
the  "integral  canonical  expansion"  of  the  random  functions  (Pugachev, 
1965). 

If  the  random  coefficient  a(t,r,o)  and  the  forcing  function 
x(t,r,ui)  are  wide-sense  stationary  stochasLic  processes  with  zero  mean, 
their  integral  expansions  are: 


att.r,^)  •  f'  A(u,r  ,w)eiut  du 


and 


(4 . 6a  ) 


x  (t ,  i  ,ui) 


CW 

/  —  i  2 1 

/  X(z,r,w)e  dz  , 

-  qo 


(4.6b) 


where  u  and  z  are  real  variables.  The  integrals  of  (4.6)  should  be 
written  as  Stieljes  integrals 


Or ( t  ,  r  ,u>) 


QU 


iut 


d  A  (u,w) 
o 


(4.7a) 


a  nd 


x(l  ,r.ui) 


i  t  t 

t 


X  (z,1'1) 
o 


(4.7b) 


-  00 
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because  d  A  (u.w)  and  d  X  (z,ui)  are  stochastic  processes  with 
o  o 

orthogonal  increments,  and  the  functions  A^u.w)  and  Xo(z,w)  need 
not  be  differentiable.  For  simplicity,  the  integral  expansions 
(4.6)  are  used  with  the  understanding  that  A(u,r,w)  and  X(z,r,io) 
may  be  generalized  functions.  The  assumption  that  x(t,r,w)  and 
a(t,r,(a)  have  zero  mean  constitutes  no  loss  of  generality,  because 
the  mean  value  of  a(t,r,ui)  can  be  included  with  the  deterministic 
part  of  the  coefficient  and  the  non-zero  mean  value  of  the  source 
term  x(t,r.u»)  can  be  easily  taken  care  of  by  superposition.  The 
vide-sense  statlonarity  assumption  constitutes  a  more  ser’ous  loss 
of  generality  but,  without  this  assumption,  the  solution  of  (4.5) 
becomes  very  difficult.  In  future  work,  it  would  be  desirable  to 
remove  this  assumption  Actually,  the  s  ta  t.  i  ona  r  i  ty  assumption  can 
be  slightly  relaxed  by  assuming  that  a(t,r,w)  are  processed  reducible 
to  atationary.  This  will  be  discussed  shortly. 

Substituting  (4.ba)  and  (4.6h)  into  (4.5),  then  multiplying  both 
sides  of  the  equation  by  e  l6t  and  integrating,  equation  (4.5)  becomes: 


-1st  .2  ,  ~  .  1 

dt  e  (V  y(t,r,u>))  -  , 


- ist  d  _  . 

d  t  e  — ^  y  v  t  ,  r  ,«>) 

>t‘ 


d  t  e 


H 


lut 


due  A  (u  ,  i  ,u>)  v  ( t  ,  r  ,uj) 


dt  e 


ist  ! 


d z  X(t,i ,u)  e 


i  z  r 


(4.8) 
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where  s,  u  arm  z  are  real  variables.  Interchanging  the  order  of 
2 

integration  and  y?  operation,  the  first  term  in  (4.8)  becomes 
2  - 

27th7  Y(s,r,'a).  Integrating  by  parts,  the  second  term  in  (4.8) 

2  2  - 

becomes  2 «  s  /c  Y(s,r,w),  and  the  third  term  becomes 


du  A(u,r,ui)  dt  y(t,r,*a)  e 


- i (s-u )  t 


(4.9a) 


s  du  A(u,r,^j)  Y(s-u,r,u)) 


(4.9b) 


To  obtain  these  results,  the  following  quantities 


e  lftt  y(t,r,ui) 


(4. 10a) 


-  is c  .  _  . 

e  y(t,r,w) 


(4.  I  Ob) 


ist  4 


du  A(u,r,*')  y(t,r,ui)  e 


(4.  10c) 


-  1 8  t  .  .  ~  ,  Hit 

e  Uu  A  (u,  r  ,e)  v  (t  e 


(4.  lCd) 


must  vanish  as  t  approach*'*  +  ■». 


If  x(t,i  ,u)  is  ;i  wide-sense  stationary  stochastic  nrocess,  the 
terms  of  (4.10)  do  not  vanish  as  t  -*  +  »,  because  wide-sense 

scationsri ty  of  x(t,r,sj)  implies  that  the  forcing  function  is  active 
frcsn  time  -»  to  +».  This  is  physically  unreasonable .  To  remove  this 
difficulty,  it  can  be  assumed  that  x(t,r,w)  is  a  process  chat  is 
'reducible  to  a  stationary  process".  A  stochastic  process  is  said 

to  be  reducible  to  a  stationary  process  if  it  can  be  expressed  in 

★ 

terms  of  stationary  stochastic  processes.  An  example  of  a  stochastic 
process  which  is  reducible  to  a  stationary  process  is  any  process  ot 
the  form 


x(t,u))  -  g(t)  z(t,u j)  +  f(t)  , 


(4.11) 


where  z(t,w)  is  a  stationary  stochastic  process,  end  eft!  and  f(t! 
are  reel  nonrandom  functions  of  time.  In  particular,  we  may  take 
£(t)  to  be  zero  and  g(t)  can  be  selected  so  tha,.  the  terms  of  (4.10) 
vanish  as  u  -»  +  For  example,  if  taken  to  be 


g(t)  -  e 


(4.12) 


where  k  la  some  email  positive  number,  then  x(.t,r,w)  is  a  process 
reducible  to  a  stationary  process  and  terms  of  (4.10)  vanish  as 
t  -+  +  « .  (This  device  is  frequently  used  in  the  theory  of  distributions.) 
The  source  term  becomes 
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X(z,r,u))  c*  dz 


■,«*») 


i  (z-s )  r 


dz 
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oo 

r- 

j  X(s,r,ui)  6(z-s)  dz 

-•0 


*  2n  X(6,r,w)  .  (4.13) 

Collecting  the  results,  the  spectral  representation  of  the  differential 
equation  (4.5)  becomes 

00 

^  ^  _  _  _  n  _  ^ 

V  Y(s,rfwj  +  s^/c  Y(s ,  r  ,u))  -  X(s,r,u>)  -s  j  du  A(u,r,w)  Y(*-u,r,u))  . 

j 

-ao 

(4.14) 


The  left-hand  side  of  the  equation  (4.14)  is  simply  the  Helmholtz 
equation  fur  the  spectral  representation  of  the  scalar  wave  function 
Y(s,r,cj).  Solutions  of  the  Helmholtz  equation  are  known  for  a  number 
of  different  boundary  conditions;  therefore,  for  these  conditions 
(4-14)  can  be  expressed  as  an  integral  equation: 


Y(s,r,u>) 


.  -I  2 
F  ( s  ,  r ,  w)  -  L  s 


Y(s-u,r',u))  A(u,r',u>)  du 
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-  00 


(4.15) 


where  L  is  the  inverse  onerator  ior  the  Helmholtz  equation  tor  the 
appropriate  boundary  conditions.  F(s,t  ,w)  denotes  L  *  X(s,r',w)‘, 
that  is,  F(s,r,tj)  is  simply  the  solution  ot  the  deterministic  Helmholtz 
equation.  The  iterative  solution  is  simplified  if  a  change  of  variable 
is  made  in  the  last  integral  and  the  integral  equation  (4.15)  is  written 
a  s : 

00 

_  «  2  r  —  _ 

Y(s,r,w)  *F(s,r,uj)  -  L  s  Y(u,r',u)  A (s-u , r ' ,u)  du  . 

-•0 

(4.16) 


Now,  the  scalar  wave  equation  (4.5)  has  been  converted  into  a  Fredholm 
integral  equation  for  the  spectral  representation  of  the  scalar  wave 
function.  To  solve  these  integral  equations,  either  the  Neumann 
series  expansion  or  the  degenerate  kernel  approximation  can  be  used. 

For  the  sake  of  being  more  specific  and  for  simplification,  attention 
Is  restricted  to  the  wave  propagation  in  a  spherical  coordinate  system- 
The  degenerate  kernel  approximation  is  considered  first. 

4  *  3  Degenerate  Kernel  Approx irna  t ion 

The  integral  equation  (4.16)  becomes  an  integral  equation  with  a 
degenerate  kernel  if  the  following  usual  approximations  for  large 
R  are  used : 


and 
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cos  +  0  (“— ) 
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(4.17a) 
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(4.17b) 
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With  ‘  sc  ar>nrox  in.)  t  ions  ,  (4  .  lf> )  •  -cows  : 


Y(s,k,w)  *=  F(s,R,w) 

2  s  «  °° 

f  s  exo  [  -  i  —  (R  *  R :  cos  » ’  )  ] 

+ - - -  Y  (u  ,  K 1  ,  t-j)  A(s"u,R',w)  du  dv  . 

f,  4n  K 

V  ~  20 

(4.18) 


The  geometry  of  the  problem  is  shown  in  Figure  4.1.  V  denotes  volume 
integration  over  the  volume  occupied  by  the  random  medium.  This  is  an 
integral  equation  with  a  degenerate  kernel  and  it  can  be  solved  by 
assuming  a  solution  of  the  following  form: 

9  exp  [-i  ~  R 1 

Y(s,R,uj)  -  F(s,R,w)  +  B(w)  s~  - 2 -  .  (4.19) 

4k  R 

Substituting  (4.19)  into  (4.18)  and  solving  for  By^),  we  .*we: 
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/  exp[i  R1  cos  \j/*]  F(u,R,#u))  A  (s-u ,  R  *  ,  w)  du  dv 
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Sucetituting  (4.20)  into  (4.19),  tne  solution  of  the  degenerate 
integral  equation  (4.18)  becomes: 
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V  l  "  i  ‘  .  •') 


exp'-i  ~  (K  -  K'  cos  ,')i  A(s-u,K',i*j)  du  dv 

c 


__s _  V 

4r  R 


1  -  !  i  ~ — ~7~  expf— ~(s  cos  >'  -u)]  A(s-u,R*  du  dv 

*7T  K  1  C 


(4.21) 


As  In  section  3.3,  the  resolvent  kernel  of  the  degenerate  integral 
equation  (4.18)  can  be  defined  from  (4.21): 


r(s,u,R,R' ,w)  " 


2  exp[-i  ~  (R  -  Rf  cos  v*)]  A (s~u , R*  ,w)  du  dv 


u  l  R 

•  ^  ~r7  exp[— —  (s  cos  \Ji'  -u)]  A(r  -  ,R'  ,u>)  du  dv 


(4.22) 

Inspection  of  (4.21)  and  (4.22)  reveals  the  same  difficulties  that 
were  discussed  in  section  3.3.  Namely,  the  denominator  of  the 
resolvent  kernel  may  vanish  because  A(a-u,K',ia)  is  a  stochastic  process. 
If  the  denominator  vanishes,  the  resolvent  kernel  does  not  exist. 
However,  it  can  be  shown  that  this  is  an  event  of  rero  probability  if 
the  probability  density  function  of  7, 


/  /=v 


,1R' 

exp[— ^~(8  cos  y 


-u)]  A(s-u,  R'  ,ui)  du  dv 


(4.23) 


■mb- ana- 
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exists  and  is  coni  inuons  in  some  lie  1 ,  or  hood  or  r  m  +  1  .  To  cwmi-uif 

t^e  statistic?!  measures  of  Y  (a , R,w) ,  the  denominator  of  the  resolvent 


Kernel  mu6t  tie  expenaea  in  a  power  series  oi 


power  aeries 


expansion  is  valid  with  probability  one  if  [ y j  <  1  with  probability 
one.  Vote  that  (4,23)  does  not  have  a  singularity  at  R1  ■  0,  because 
the  volume  element  dv  contains  a  R'  squared  term. 

The  power  series  expansion  for  (4.21)  is: 

Y(s,R,u>)  “  F(8,R,u) 


*  r  r 

7 ~  „  '  j  j  exp[-i  -  (R  -  R'  cos  >* '  )  )  F(u,R',u))  du  dv 


(i  +  y  +  7 


)  . 


(4.24) 


where  y  is  given  by  (4.23).  It  can  be  seen  from  (4.24)  that  the 
ensemble  average  of  Y(s,R,uJ)  16  zero  if  the  ensemble  average  of 
F(a,R,u)  is  zero.  This  follows  from  the  assumption  that  X(t,r,ui) 
and  a(c,r,i*))  are  statistically  Independent,  zero  mean  stochastic 
processes.  The  statistical  measures  that  are  of  greater  interest 
are  the  power  spectral  density  and  the  coherence  functions.  These 
quantities  are  Fourf°r  transform  pairs  of  one  another.  The  power 

spectrum  i®  related  to  the  spectral  representation  of  the 

* 

random  variable  by 

<  d  X  (a.)  d  X  (s  )  >  -  h(s  -  s,)  #  (a.)  d  s  d  s 

I  2  12  xx  112 

(4.25) 
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Discussed  in  greater  detail  in  Chapter  II,  sections  2.6  and  2.7. 


Figure  4.2 


Geometry  for  Double  Integration 
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Because  w«-  arc  ec  ritually  interested  in  computing  the  inherence 
between  two  spatially  separated  points  (figure  4  .  j  ,  we  calculate 

★ 

<  Y  (s ,  ,  R  ,  ia)  Y  (s,  ,  R , ,  cj)  n.  Using  Just  the  first  term  in  rh 
power  series  expansion  (4.24),  we  have : 


<  Y  Rj.  -»)  Y  (s7  .  K..  .  a)  > 


f  (s  ,  ,  R,  >  F  (s  ,  ,  H-,  ,  e) 


7  2 

*1  *2 


exp  -i  —  (K  -R*  cos  .')  ♦  1  (K .  -  R"c  os  * " ) 
I  c  2 


(4x  )  R  K  V  V  -« 

i  4t 


*  * 

f  ( u  ,  R '  ,  e )  f  (a*  ,R".w>)  •  •  A(e.  -u  ,R  '  ,U)>  A  is  . -u  '  ,K",  )  >  du  du'  dv  dv’ 

i  i 


*FF  <  S  1  ’  *1'  V  F  (S1  •  6  2  }  + 


2  2 


H(s, ,s,,R. ,R, .R' ,k")  *  _(u,R' .R")  f(u-n') 
1212  FF 


V  V  -  -  •» 


A(s  -u.K'.ia)  A  (s,, -u  '  ,  R"  ,  <)  s  du  du'  dv  dv' 


•$FFVS1  .  R,  .Rj  )  1  -  «2) 


2  2 
B;  *2 


H(®  1  *  *2  ’ R 1  ’  ^2  ’  R  '  'R,,)  *ff(u,R'  *K,,) 


V  V  -® 


C  (s  -u,K*,R")  du  dv  ov'l  c  (* 

m  1  1 


(.4 . 26a  ) 
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where 

h(b1,.2,r1,r2,r',r")  - 


1 

(4*)2RjR2 


exp [ - i 


c 


(R^R' 


COS  * ' )  +  i  - 

c 


(R2-R"  cos  *,j)] 


(4.26d) 


The  cross  terms  of  the  form 


<  F(W“>  -St 


go 

j  f  exp(  +  i  “  (R  -  R' 
V 


cos  4')]  F  (u,R',w)  a  (s2-u,R!,u))  >  du  dv 


(4-27) 

* 

vanish  because  the  average  <  A  (s2-u,R  ,w)>  vanishes. 

From  (4.26),  we  note  that  using  Just  the  first  term  of  the  expansion, 

<  YCSj^R^w)  Y*(s2 ,R0  ,<j)  >  is  equal  to  a  delta  function  times  the 
sum  o£  twc  terms.  The  coefficients  of  the  delta  function  &(s^-s2) 
are  interpreted  as  the  power  spectral  density  of  the  solution  of  the 
scalar  wave  equation.  The  fact  that  we  get  a  delta  function  bCa^-s^ 
•hows  that,  at  least  as  far  as  the  first  approximation  is  concerned, 
the  solution  of  the  scalar  wave  equation  is  a  wide-sense  stationary 
process.  (For  greater  generality,  the  correlation  between  two  spatially 


Discussed  in  section  2. 


separated  wave  functions  was  computed.  Of  course,  we  have  a  special 


case  when  equals  R„ . )  Thus .  the  simplest  approximation  of  the 
power  spectral  density  of  the  wave  function  is,  from  (4.26), 


(s.R,  ,R  )  =»  ®  (s,R  ,R  ) 
yy  i4  f  r  14 


+  s 


H(s  ,  s  ,R ,  , R0  , R'  ,  R")  0  (s-u  , R'  , R")  $  (u  ,  R'  ,K")  du  dv  dv' 
J  l  OQ  r  r 


V  V  -« 


(4.28) 


This  crude  approximation  has  already  some  interesting  features.  The 
first  term  is  the  power  spectral  density  of  the  wave  in  the  deter¬ 
ministic  t iroe- invariant  medium.  The  second  terra  demonstrates  the 
spreading  of  the  power  spectral  density  of  the  wave  function  by  the 

randomly  time-varying  medium.  Even  if  $  (s,R.',RM)  is  a  lewpass 

QO 

function  and  it6  power  spectrum  does  not  overlap  the  power  spectrum 
of  fcppCu.R' ,R") ,  the  power  spectrum  of  0^ (s , )  is  modified  by 
the  randomly  time-varying  medium.  This  is  illustrated  on  Figure  4.4. 
Thus,  the  widely  used  quas imonochroma t ic ity  assumption  is  incorrect, 
or  at  least  should  be  seriously  questioned.  Equation  (4.28)  is  an 
approximate  expression  for  the  stochastic  Green's  function.  It  is  an 
integral  expression  that  relates  the  power  spectral  density  of  the 
solution  to  the  spectral  density  of  the  source  term  and  stochastic 
medium. 

The  next  approximation  can  be  computed  by  including  the  7  term 
in  the  power  series  expansion  (4.24). 
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The  cross  terms  give: 


<  F  (b2,R2,w) 


4jtR, 


i  r  r  8 1 

-  [  /  /  exp  [-1  —  (R^-R*  cos  *')]  F(u,R','Jj) 


J 

v 


A (s  1  -u , R1  ,u))  du  dv  ]  y  (s^)  > 


4nR. 
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V  V  -«  -- 


<  F  (u ,  R'  ,w)  F  (s?>R2,w)>  <  A(8l-u,R',w)  A(fil-u’ ,Rt,,w)>  du  du*  dv  dv' 


r  r  r  r  u*2 


4nR 


V  V  -00  -00 
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;r  exp  [-  —  (R.-R'cos  D-i'—  (s,co8r-u')] 

C  i  cl 


^i-pCu.R*  ,R_)  S(u-8~)  $  (s  -u,R*,R")  SCu-K'1)  dv  dv’  c!u  du' 
”  £■  *  nrr  1 


2  2 
“l  82 


is, 

t , 


v  v  (4n)  Rj.R31 


{pu 

exp[-~(Rl-R'co8  }:)+  ~(slcos*M  +  Sj)] 


«pF(»1,R,,R2)  ®on(81+82.R,,R")  dv  dv’  , 


(4.29) 
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and 


2  * 
exp  U  —  (R2  -  R' cosy ' ) j  F  (u.R'.w) 


A  («2-u,R',w)  du  dv)  7  (s2)  >  - 
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(Fts^R^w) 


4rtR„ 


00 
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V  -«0 
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4*R_  J  J  J  J  4«R"~  exp  [i  ~  <VR>  cos  c  («2co8r-u')] 

^  V  V  -» 


<  F^j.Rj.u)  F*(u,R',u))>  <  A*(82-u,R' ,w)  A*(s2*u,,R",u>)  >  du  du'  dv  dv' 


4jiR„ 
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exp  [i  — * ■  (R  -R’cosy')  -  ~  (sco8*"-u' )  1 
c  *  c  l  J 


4*R" 


V  V  -« 


^FF^U,R1  R  ^  ®^(s2” u'  >R'  »R")  Mu  +  uV)  du  du'  dv  dv* 


V  V 


1 

(4«)2R2R" 


exp 


<R2-R’;o8*') 


iR" 

~  (82C08*"  + 


♦ff^i»Ri,r')  •  (^  +  ®2  *  &'.K")  dv  dv' 


(4.30) 
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These  two  terms  exhibit  the  nonstationary  behavior  of  the  solution, 

because  of  the  absence  of  delta  functions  BCs^-s^)-  However,  these 

terms  vanish  if  the  power  spectra  $  (s,+s„)  and  (s,)  do  not  overlap 

<Xt  l  2  FF  1 

as  happens  ir  some  cases  of  practical  Interest.  If  this  is  true  for 
all  s.  and  ,  then  (4.29)  and  (4.30)  vanish  and  the  wave  function 
still  remains  wide  sense  stationary.  Note  that  even  in  the  case  of 
the  nonoverlapping  power  spectra,  the  time-varying  random  medium  still 
spreads  the  power  spectrum  of  the  wave  function  as  shown  by  (4.28). 

The  next  term  that  contains  a  delta  function  ’'(s^-s^)  is: 


s]  !  i  !  I  H(6r62,R1>R2,R\R")  <  F(u,R\*)  F*(u\R’»  > 

•J  \J  '■J 

V  V 


<  A(s^-u,R<,w)  a  (s0"u',R",w)  7(Sj)  7  (s ^ )  >  du  du'  dv  dv’ 

(4.31) 

To  evaluate  this  term,  we  need  to  know  the  fourth  moment  of  A(u»R,u>) 
or  make  an  additional  assumption  that  a(t,R,^’)  is  Gaussian.  If 
a(t,R,u0  is  Gaussian,  then  A(u,  R,w)  and  7  are  algo  Gaussian  processes. 
This,  howr  er,  viorates  the  condition  for  validity  of  the  power  series 
expansion  of  the  denominator  of  (4.21).  For  the  power  series  (4.24) 
to  converge  almost  everywhere  in  probability,  |y|  <  1  a.e.p.  Tills 
condition  is  not  satisfied  when  y  is  a  Gaussian  process,  and  the 
power  series  doe6  not  converge.  This  also  follows  from  the  actual 


* 

Discussed  in  section  2,8  and  also  in  Moyal  (1949). 
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eo 

(1  +  J  j  j'  Hj  (s,u,R' ,R")  ‘{^(s-UjR1  ,R")  du  dv  dv*  .  .  .)» 

V  V  -00 

(4.32a) 


where  H(s , s^  ,R2  ,R' ,R")  Is  defined  by  (4.2Cb)  and 


(s.u.R*  ,R")  « 


exp  [  —  (R*  cos  -  R"  cob  *")  -  —  (R *  -  R")]  . 

‘oIdii  c  c 


(4x)  R’R 


(4.32b) 


Thue,  beside  the  stationary  term,  two  nonstationary  terms  are 

obtained,  even  when  the  random  coefficient  a(t,R,w)  is  a  GausBian 

process.  If  a(t5R,LJ)  is  not  a  Gaussian  process,  as  mentioned  before, 

(cncwlf'dge  of  ita  fourth  mo  'nt  is  required  for  the  detailed  evaluation 

of  (4.31).  If  more  terms  are  included  in  the  pow^r  series  expansion, 

knowledge  of  still  higher  order  statistics  of  a(t»R,u0  is  required. 

Even  If  the  power  series  (4.24)  converges  almost  everywhere,  this 

★ 

does  not  imply  the  existence  of  <  Y(s^,R^,w)  Y  (82,R2,w)  >  because 
* 


Y(s  ,R^,w)  and  Y  My  not  be  second-order  random  processes; 

2  2 

that  is,  <  |  Y  (s  j  ,R.  ,<a)  |  >  and  <  |y(s2  ,R0  ,<*>)  |  >  may  not  be  finite. 

(It  is  perfectly  reasonable  for  the  power  spectral  density  to  have 
singularities  provided  they  are  integrable.)  In  such  case,  one  may 


calculate  the  integrated  power  spectrum,  denoted  by  S 1 (s * , s", R^ , ) 
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by  Integrating  $  (s ,R^ , )  over  the  frequency  band  from  s'  to  s": 


S(s',s",RlfR2)  -  j  *_(s,R1,R,)  ds  . 


J  yy  1  2 


(4.33) 


The  above  integral  is  only  applicable  for  wide-sense  stationary 
stochastic  processes.  If  one  takes  into  account  the  nonstationary 
part  of  the  solution,  the  power  spectral  density  is  a  function  of  two 
frequencies  as  discussed  in  section  2.7.  Hence,  the  integrated  power 
spectn.-m  oin*--  written  as  a  double  integral: 


S*(6',s",s"’,s"",  RrR2) 


r 


r 


s  s 


<  Y(sltRltu))  Y  (s2,R2,uj)  >  dSj  ds2 


(4.34) 


The  integrated  power  spectrum  is  actually  a  setter  representation  of 
the  Physically  measured  energy,  because  all  instrunents  have  nonzero 
bandwidth. 

Other  statistical  measures  of  interest  are  the  mutual  coherence 

function  and  normalized  mutual  oherence  function  (Born  and  Wolf,  1  9b4  , 

Beran  and  Parrent,  1964;  O'Neill,  1963;  and  Mandel  and  Wolf,  1965). 

We  denote  these  by  C  (R,,k,,T)  and  by  c  (K-.R^.t)  for  the  wide- 

yy  1  2  yy  1  2 

sense  statlonarv  processes,  and  by  C  (R. ,K_ , L , , t_ )  and  c  (K , , K. , t . , C „ ) 
'  y  y  i  2  i  2  y  y  ’  2  1  / 

for  the  nonstat ionary  processes  where,  in  the  first  case,  r  m  -  t^. 
The  symbols  F  and  y  are  used  in  the  literature  for  the  coherence 
function  and  the  normalized  coherence  function,  but  F  has  already  been 
used  to  designate  the  resolvent  kernel  of  tile  integral  equation.  y  has 
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also  uc<?n  f  requen  t  ly  used.  For  the  wide-sense  stationary  process. 


the  mutual  coherence  function  C  (R.,R, ,t)  is  simply  the  Fourier 

yy  1  2 

transform  of  <J>  (s,R,,R_): 

yy  i  2 


Cyy<Bl'R2,T> 


I 

J 


fyy(s’W 


iST 

e  ds 


(4.35) 


and  the  normalized  mutual  coherence  function  c  (R. ,R,,t)  is 

yy  1  2 


C  (R.,R,,t) 

vv  1  2 

C  (K  ,,K “ - 

yy  [C  (R.,R.,0)  C  (R  ,R  0)] 

yy  l  1  yy  2  2 


4>  (s  ,R  ,R_ )  e lbT  ds 

yy  1  2 


(JO 


<t>  («,R,  ,R.  )  ds 

yy  i  1 


(4.36) 


c  is  also  known  as  :he  complex  degree  of  coherence.  It  is  s  useful 

yy 

concept  in  interpreting  Interference  patterns  of  partially  coherent 
light  (Beran  and  larrent,  I9bd).  The  concept  te  also  useful  In 
optical  and  radio  astronomy.  Handel  and  Wolf  (1965)  show  thac, 
on  one  hand  c  (R,,K_,t)  is  a  measure  of  the  correlation  of  the 

yy  1  2 

complex  field  at  two  points  and  ,  and,  on  the  other  ha od ,  it  is 
b  measure  of  the  sharpness  and  location  of  the  fringe  maxims  obtained 
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by  superposing  the  beams  propagated  from  these  points. 


C 

yy 


(R 


1 


.r2*t) 


atKi  Cy/VR2,T^  here  are  ersemble  coherence  functions  because  they 
are  obtained  by  ensemble  averaging,  rather  tMn  time  averaging.  Both 
ensemble  and  time  averaged  coherence  functions  are  used  (Mandel  and 
Wolf,  1965).  From  Schwarz's  inequality,  we  have: 


°  *  lCvy(VR2'T>  * 


I Cvv  »R2  »T> I 


<  1 


rCyy(VY°)]*  [Cy:  (R2’R2'0)^ 


(4.37) 


These  extremes  characterite  complete  incoherence  and  coherence, 

respectively.  The  quantities  ^(R^R^r)  and  ^(R^.t)  are  self 

coherence  function,  at  R  and  R  C  (R  R,,0)  and  C  (R,,R,,0)  are 

1  1  yy  i  yy  2  2 

the  ordinary  light  Intensity  (in  optics)  at  R ^  and  R^ . 

When  the  wave  function  is  not  wide-sense  stationary,  the  coherence 

functions  must  be  defined  in  terms  of  the  bifrequency  Fourier  transforms;* 
that  la. 


WWV  " 


I"  !  * 

I  j  <  YUj.Rj.w)  t  (*2>R2,w)  > 


MVl  +  i82C2 

e  d.j  da2  , 


(4.38a) 


* 

Discussed  in  section  2.7. 
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C  (R  R  t  t  ) 
yy  1212 


yy  i 


*  i('yy('Ri»Rlltl,tl^  i  CVy<'R2’R2,l:2't:2^  1  ^ 
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(4.39) 


The  normalized  mutual  coherence  function  as  defined  by  (4.39)  is  a 
generalization  of  the  wide-sen.  '  stationary  concepts  to  the  case 
when  the  wave  £ unction  is  not  uide-sense  stationary.  The  Fourier 
transforms  (4.35)  and  (4.38)  express  the  :nutual  coherence  functions 

for  the  wide-sense  stationary  and  for  the  nonets tionary  processes. 

* 

If  satisfactory  approximations  Cor  the  <  Y(SpR^,w)  Y  (aj^^)  > 
have  been  obtained,  then,  at  least  in  principle,  it  is  a  simple 
matter  to  compute  the  mutual  coherence  functions  from  (4.35)  or 
(4.38),  To  carry  out  the  detailed  computation  of  these  Fourier 
transforms,  knowledge  of  the  statistics  of  the  source  and  stochastic 
medium  is  reeded.  In  particular,  for  the  source,  we  need  the  power 
spectral  density  $„,,.(u)»  and  for  the  stochastic  coefficient,  we  need 
it*  power  spectral  density  and  higher  order  spectral  moments.  We 
have  Indicated  a  method  by  which  the  mutual  coherence  functions  may 
be  calculated  for  a  scalar  wave  propagating  in  a  randomly  time-  and 
space-varying  medium.  According  to  Bersn  and  Parrent  (1964),  this 
has  been  an  unsolved  problem. 
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In  the  next  section,  the  Neumann  series  expansion  of  the  integral 
equation  (4.16)  is  investigated. 

4 . 4  Neumann  Series  Expansion 

To  obtain  a  Neumann  series  solution  for  the  integral  equation 
(4.16),  a  solution  of  the  following  form  is  assumed: 

Y(s,r,w)  *  X°  Y  (s,r,w)  +  X1  Y,(s,r,w)  + 

o  i 

.  .  .  \n  Y  (s ,r,w)  ...  .  (4.40) 

n 

Substituting  the  assumed  solution  (4.40)  into  the  integral  equation 

90 

Y(e,r,u))  »  F(s,r,i*))  +  X  L  1  j  Y(u,r',w)  A(s-u,r‘  ,(J)  du  , 

'J 

-00 

(4.41) 

and  equating  the  coefficients  of  the  same  powers  of  X,  the  following 
iterative  solution  is  obtained: 


V  (s , r ,<*>)  -  F(s,r,w) 


(4.42a) 


—  - 1  2 

Y^o.r,^)  -  L  s  j  Yo(u,r',u))  A(s-u,r',w)  du 


■  L  *  /  F(u,r',w)  A(s-u>r,,w)  du  ,  (4.42b) 


142 


and 


Y„(s,r,w)  -  L  *  s"  Y^(u,r',uj)  A(a-usr' ,u)  du 


.-1  2 

L  8 


/  L  u  du  i  F(u'  A(u-u',r',^)  du' 


(4,42c) 


The  general  term  is 

00 

—  -I  2  !  —  — 

Y  (s,r,uJ)  »  L  s  /  Y  .  (u,r',u>)  A(8-u,r’ ,w)  du  , 
n  /  n~  i 

-CO 

(4.42d) 

where  L  ^  is  the  inverse  operator  for  the  Helmholtz  equation  and  its 
boundary  conditions.  In  the  spherical  coordinate  system,  the  inverse 
operator  for  an  outgoing  wave  is: 


dv 


exp  f  - i  ~  |  r  -  r ' ( ] 
4n  |  r  -  r*  ! 


(  •  )  . 


(4.43) 


where  4v  is  the  volume  element  in  the  spherical  coordinate  system, 

and  /  Indicates  volume  integration  over  the  space  containing  the 
V 

randomly  space-  and  time-varying  medium.  For  simplicity,  denote 
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G(s,r,r' ) 


?xp  f  -1  ~  j  r  -  r 1  !  ] 


(4.44) 


4  t  I  r  -  r 1 


Recalling  from  (4.16)  that  X  ■  -l,  the  Neumann  series  iteration  becomes: 


Y(sfr,u)  «  F(s,r,“>)  -r 


2  f  r 

+  X  s  j  G(e,r ,r‘ )  A(r-u,r* , 


J  J 

V  -00 


u)  F(u,r,w)  dv  du 


-  / 

+  X‘  s"  j  j  I  j  (u*’G(s,r  ,r*  /G(u,r'  ,r") 

J  j  J  J 

V  V  -«> 


A(s-u,r')  A(u-u",r,!)  F(u' ,r",«*»))  dv  dv'  du  du' 

+ 

(4.45) 

This  series  has  some  interesting  physical  interpretations.  The  first 
tens  after  F(s,r,u>)  can  be  interpreted  as  the  first-order  scattering 
of  the  wave  by  the  random  medium.  It  is  the  widely  used  Born  approxima¬ 
tion.  A  number  of  papers  and  books  consider  only  the  Born  approximation. 
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The  Born  approximation  gives  a  satisfactory  answer  if  only  single¬ 
scattering  is  important.  The  higher  order  terms  are  the  multiple- 
scattering  corrections  and  must  be  taken  into  account  in  long  distance 
wave  propagation  through  the  random  medium. 

The  single-scatter ing  approxiroa t ion  is  investigated  first.  After 
that,  the  multiple  scattering  and  the  convergence  of  the  Neumann  series 
expansion  is  investigated.  The  statistical  measures  of  interest  are 
the  power  spectral  density  and  the  mutual  coherence  functions.  The 
single  scattering  approximation  gives: 

<  Y(s^,r j ,w)  Y*(s2,r2>u))>  «  <  FCs^r^u)}  F  (s2>r2,w)> 


+  A.2s^82  J  f  j  I  G( 81»r1.r')G  (s2,r2,r")  <F(u,r',<«)  F(u',r",ui)  > 
V  V  -« 


X 

<  A(s^-u,r' ,w)  A  (62~u' , r",w)  >  du  du'  dv  dv' 


*  ®FF(fli,ri*r2)  6(8f82)  + 


.2  2  2 

X  8ls2 


J 


j  G(8  j ,  r ,  ,r '  )  G  (s2,r2,r">  <$FF(u,r’ ,r")  b(u-u’) 


V  V  -• 


<  A(*^-u,r' ,w)  A  (s^u' ,r",w)>  du  du"  dv  dv' 
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®FF^Srrl,r2^  °(W 


+ 


.  2  2  2 
\  Sls2 


r  j  -  —  *  -  - 

/  j  GCSj.r^r  )  G  (s2>r2>r") 

V  V 


®  (s.-u.r'.r")  ®  (u,r',r")du  dv  dv' 

oa  1  FF 


(4.46) 

The  cross  terms  have  vanished  because  A(s-u,r,w)  i6  a  process  with 
zero  mean.  The  approximate  expression  for  the  power  spectral  density 
is  the  sum  of  the  coefficients  of  the  delta  function  6(8j-b2);  i.e., 


$ 

yy 


(B,r1 


~  ^FF^s,rl,r2) 


+ 


4 

8 


/ 


•Q 

J  J  GCs.r^r'jG  (s,r2,r") 

V  -« 


Q  (s-u,r',r”)  ®  (u,r',r">  du  dv  dv' 

oa 

(4.47) 


This  expression  reduces  to  (4.26)  if  the  approximations  (4.17)  are 
used  to  simplify  the  factor  G(s,r^,r')  G  (s^.r^.r");  that  is,  this 
factor  becomes  then  H(s , s ,F^ ,R2 ,R' ,R' )  as  defined  by  (4.26b).  This 
expression  again  demonstrates  the  spreading  of  the  power  spectral 
density  of  the  wave  function  by  the  randomly  time-varying  medium. 
Equation  (4.47)  again  shows  that,  as  far  as  the  first  approximation 
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is  concerned,  tue  wave  function  is  a  wide-sense  stationary  process. 
An  approximation  for  the  normalized  mutual  coherence  function  can 
be  obtained  by  substituting  (4.47)  into 


Cyy(rl’r2,T) 


%y<s*rrr2)  e"ibT  ds 


*  -oo 


V(S,ri*r2)  dB  /  \y(s*r2'r2)  dS 


(4.48) 


and  carrying  out  the  indicated  integration. 

If  multiple  scattering  is  important,  more  terms  must  be  included 

in  the  Neumann  series  expansion.  In  such  instances,  we  have  for  the 
th 

n  approximation 

<  y(s1,71.w)  y*(s2,72,w)  >n  - 

•  <  (A°  Y0(*1,r1,u)  +  A  V1(s1,rl,ui)  +  Y2(s]l,r1,u))  +  •  • 

+  An  Yn(i1,71>«))  (A°  Y0*(«2,r2.‘*»)  +  A1  'i  *  ( a2,72,w)  + 

A2  Y2*(s2,r2,uj)  .  .  .  An  (s2>r2>io)  )  > 


(4.49) 
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Carrying  out  the  indicated  multiplication  and  averaging  we  ge'  : 


<  Y(sltrltu)  Y  (s2,r2,w)  >r 


X  <  Y  (s  ,r  ,u>)  Y  (s..  ,r  ,ui)  > 
oil  o  LI 


+  X  {  <  Yo(81,r1,w)  Y2  (s2>r2,u))  .>  +  <  Y2^s\,rrW)  Y0  ^ s2,r2 > 


+  <  Y1(si»ri«u;)  yl  (s2,r2,u>)>  )  +  X  (  Y2(e1,r1,w)  Y2  (62>r2>uj) 


<  Y3  (S 1  * r  1  •w)  Y»  (s->>r2*u,)  '*  +  <  Y,  (Sj.r,  .“>)  Y,  (s.,,r?,w)  > 


+  <  VW*0  Y4  (s9>r2^  +  Y4  1  *  rl ,ui^  Yo^62,r2,U)^  '  ' 


+  .  .  .  X2"  (2n  +  1  terms) 


(4.30) 


The  coefficients  of  odd  powers  of  X  are  zero  because  it  is  assumed 

that  tiie  odd  moments  ol  A(u,r,u).  It  th>s  assumption  is  not  made, 

the  odd  terms  must  be  included.  The  terms  v  Y  (s,,r,,uj) 

o  1  1 

★  -  -  *  -  - 


(s2  ,r2  ,u>) 


Yi(VV'0)  Yi 


(s 


f2  ,>*>) 


and 


Vv 


r  ^ ,  w) 


* 


\  (S2 
(3.47) 


r 


2>uj)  >  were  already  computed  tor  the  first-order  approximation 
The  X2  terms  are : 
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<  WV*0  Y2  (a2,r2,u)  >  - 


*2  J  J  J  J  u2g*Cs2 -r2  »r’ )G*(u,r ' .r")  <  A*(s,-u,7 

V  V  -« 


<  F  (u',r",u))  FCSj.r  ,w)  >  du  du'  dv  dv' 


')  A  (u-u'.r”)  > 


2  r  r  r  r  2  * 

*2  J  J  j  j  u  G  (B2*r2,r  -r'">  <  A  (s2*u,r 

V  V  "-oc 


’)  A  (u-u'.r")  > 


®pp(u*  •  .r")  f'Cu'-Bj)  du  du'  dv  dv1 


2  f  r  f  2  * 

J  I 

V  V 


/  /  uG  <®2  •  r2  * r '  >G*<u.r'  ,r")  v  A*(8.,-u,r 


'  )A (s ^ -u, r ")> 


♦pp (* ^ . r 1 ,r")  du  dv  dv’  » 


6<*2'‘l)  *2  j  1  j  u^g*(*2  ’  r2  ’  r i ^  MuJ'.f") 


V  V  -« 


*^(*2  "u  • 1 "  •  r  *)  ®FF^*l,r  ,r")  dv' 


(4.51) 
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The  contribution  of  thi-'  term  to  the  power  spectral  density  is 


2  f  ■  f  2  *  —  —  *  —  —  —  —  —  — 

6  /  i  u  G  (s,r,,r‘)G  (u,r’,r")  $  (s-u  ,r  ’  ,  r  ")$  (s  ,  r ",  r .  )du  dv  dv  1 

j  2  o a  FF  l 

v  V  -« 

(4.52) 

Similarly,  the  contribution  to  the  power  spectral  density  from  the  term 

—  ★ 

<  Y  (s  ,r,uj)  Y  vs-.r  uj)  >  is- 
l  1  Oil 

s“  u2G(s  ,  r  ,  r '  )r.(u,  r  ’  .  r")  $  (s-u ,  r '  , r")  <t>  (s,r_,r")  du  dv  dv  ' 

1  or,  IF  2 

V  V 

(4.53) 

These  two  terms,  (4.52)  and  (4.53),  do  not  contribute  any  energy  to 

the  frequencies  which  are  outside  the  spectrum  of  F(s,R,ui)  because, 

in  both  ot  these  integrals,  the  argument  of  the  power  spectral  density- 

term  (♦  (a,r",r.)  in  (4.523  and  $  (e,r,,r")  in  (4.53))  is  s;  i.e., 

Ft  1  F  r  i 

same  argument  as  the  argument  ot  the  dependent  variable.  For  both 
cases,  the  variable  of  integration  is  u.  The:etor«*,  at  frequencies 
where  the  factors  4^.  (s , r" , t ^ )  and  $  (s.r^.i-")  In  the  integrand 

vanish,  the  respective  integrals  vanish  and  these  terms  do  not 
contribute  to  the  spreading  ot  the  power  spectral  density.  Thia  is 
not  the  case  with  the  last  term  ot  (4.47)  where  the  argument  of 
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(u,  r  '  ,  r '")  is  Same  as  the  variable  of  integration  (u)  .  Hence, 

r  r 

this  term  shows  spectral  spreading  beyond  the  original  band  of 

frequencies.  These  two  terms,  (4.52)  and  (4.53),  are  also  expressions 

tor  spectral  density  of  wide-sense  stationary  processes  because  they. 

too,  are  coefficients  of  delta  functions  fc(s  -s0). 

The  computation  of  the  higher  order  terms  requires,  in  general, 

knowledge  of  higher  order  moments  of  the  random  coefficient  a(t,R,0- 

Only  if  Qf(t,R,u>)  Is  a  Gaussian  orocess  is  knowledge  of  the  first  two 

moments  sufficient  to  specily  all  higher  moments.  As  Si.own  in  (4.50), 

2  n 

A  is  multiplied  hv  the  sum  of  2n  +  1  averages.  In  the  case  of  the 

Gaussian  process,  each  average  produces  ~  terns.  For  this 

2n  n'. 

reason,  it  can  be  expectc'  that  the  Neumann  series  expansion  diverges 

for  the  Gausaian  processes.  Detailed  calculation  shows  that  onlv  one 

of  the  terms  produces  i  delta  Junction  t(s  -s,).  Thus,  the 

2n  n:  1  ‘ 

stationary  part  ol  the  f  imann  series  expansion  may  converge  (it 

additional  conditions  tor  convergence  are  satisfied)  even  it  the 

nonatationary  part  of  the  series  diverges. 

The  series  expansion  (4.50)  converges  it  the  nwn-nitudes  ot  the 

coefficients  of  A  '  are  smaller  than  (2n  +  1)  M~ '  ,  where  M  •-  1.  It 

these  conditions  are  true,  then  the  series  expansion  (4.50)  converges 

pecause  it  ta  dominated  by 


(1  -  x)  ‘  •  1  t  +  Jx‘  + 


(n  +  1 )  x 


(4.5-0 


These  are  sufficient  condition*  tor  convergence;  the  series  (-«.5u) 
may  converge  i"  -r  leas  restrictive  conditions.  The  u*-  factor  in  the 


151 


integrand  ot  (4 . 52  )  dot  .<•  not  c.iui-c  tiny  dii t icuity  with  the  inf  ini"? 

Integra  t  ior  becuu;  <  both  *  (u)  ...  !  ?■  (u)  art-  either  band  limi  ted 

•Xi  r  r 

or  they  behave  in  manv  cases  approximately  as  — 7  or  * t  least  as 

*4 

U 

~ ■  tor  large  u  (Tacarski,  l/ol). 
u 

In  the  actual  evaluation  01  the  volume  integrals,  simplifying 
approximat ions  car  he  made  a ’though  we  shall  not  do  any  such 
calculations.  For  example,  in  ealuatior  at  the  volume  integral  in 
(3.44),  it  can  he  observed  that  the  main  contribution  to  the  integral 
comes  t rom  the  volume  where  r'  r";  that  is,  t ;  om  the  volume  where 
|  r'  -  r"  S  is  ot  the  same  order  as  the  correlation  length  ot  the 
spatial  variation  ot  the  random  med ■  ;m.  This  is  clearly  so  in  the 
case  ot  some  of  the  widely  used  spatial  correlation  functions  ot  the 
f  01  m : 


exp 


-i  r* 


(4 . 55*) 


b*  exp  (  -  |  r '  -  r "  j  *  /'r  1 

o 


and 


2 

b 


r(v) 


(4.55b) 


(4.55c) 


where  t  is  the  con  elation  length  and  K  (x)  Is  t  R-aaei  function 
o  v 

of  the  second  kind  ot  i:.wigirarv  aigiu:ent  (Tatarskl  I'ibi  )  .  Booker 

* 

and  Gordon  (1450)  have  used  (4.55a)  and,  more  recently,  Kras  1 Ihikov 


Kraa 1  In lkov ' g  worn  la  diacuaaed  bv  Tatarski  ( 1  9b  1 ) . 
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has  usee  (4.55c).  Tatarski  (1961)  discusses  the  theoretical 
Justification  for  assuming  these  form6  for  the  spatial  correlation 
functions  and  comperes  the  consequences  of  these  assumptions  with 
the  experimental  results.  It  has  iso  been  pointed  out  by  Comstock 
(1963  and  1964)  that  the  autocorrelation  functions  of  the  same  form 
as  (4.55c)  are  capable  of  satisfying  the  theoretical  ond  experimental 
requirements  for  wave  propagation  problems  in  a  random  medium. 

4.5  General  Remarks  and  Conclusions 

Both  the  Neumann  series  expansion  and  the  degenerate  kernel 
approximation  demonstrate  the  spreading  of  the  power  spectrum  of 
source  by  the  time*  and  space-varying  random  medium.  The  quasimono- 
chromatic  assumption  ir.  the  previous  work  has  totally  neglected  this 
spreading  of  the  power  spectrum  of  ths  wave  function.  Sven  the  firBt- 
ordcr  approximation  provides  a  useful  method  for  the  computation  of 
the  approximate  spreading  of  the  pother  spectrum  of  the  wave  function. 
Higher  order  approximations  show  further  spreading  of  the  power 
spectrum.  It  thus  appears  that  the  successive  convolutions  of  the 
power  spectral  density  will  spread  the  power  spectral  density  of  the 
wave  function  even  further,  make  its  spectrum  wider  and,  therefore, 
its  correlation  tim-  bnorter.  This  agrees  with  the  intuitive  concept 
th&c  the  multiply  scattered  waves  become  decorrelated . 

In  both  methods  of  solution,  the  first  term  in  the  solutior 
(zeroth  approximation)  is  the  solution  of  the  wave  equation  in  the 
nonrandom  medium.  When  the  next  approximation  is  used,  the  wave 
function  ia  a  wide-sense  stationary  stochastic  process  if  the  source 
and  random  medium  are  wide-sense  stationary  processes.  If  tne  higher 
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order  approximations  are  used,  terms  appear  which  are  no  longer 
wide-sense  stationary.  For  the  first  approxima tions ,  the  mutual 
coherence  function  was  a  function  of  difference  of  the  observation 
times;  that  is,  CfR^K^.T),  where  t  =  t^-C^  ®ut  w^en  °r<*er 

approximations  are  used,  the  mutual  coherence  function  is  a  function 
of  the  actual  observation  times  t,  and  t^-  The  mutual  coherence 
function  must  be  written  as  C (R  , k9 ,  t  ,  )  to  express  the  dependence 

on  t^  and  t  -  Because  of  the  close  relationship  between  the  coherence 
functions  and  optical  images,  one  would  expect  fluctuation  of  the  light 
intensity  when  the  light  propagates  through  a  randomly  time-varying 
medium.  Both  "twinkling"  and  "quivering"  are  common  in  observation  of 
stars  by  telescopes  (Tatarski,  1961).  Twinkling  is  the  irregular 
fluctuation  of  the  light  intensity  and  quivering  is  the  irregular 
fluctuation  of  the  angle  of  arrival  of  the  light.  A  large  number  of 
experimental  papers  have  been  devoted  to  the  twin! ling  and  quivering 
of  stellar  images.  (Chapter  13  cf  Tatarski  (1961)  gives  a  number  of 
references.)  Under  unfavorable  observational  conditions,  instead 
of  a  luminous  core  and  a  series  of  concentric  rings,  one  observes  at 
the  focel  plane  of  a  telescope  an  irregular  patch  of  light  which  is 
dancing  around  and  fluctuating  in  light  intensity.  A  theoretical 
model  which  would  explain  this  phenomenon  could  be  based  on  the  non- 
s tat  ionary  mutual  coherence  functions. 

Both  the  degenerate  kernel  approximation  and  the  Neumann  series 
expansion  have  the  disadvantage  that  they  are  extremely  laborious,  but 
this  is  to  be  expected  ot  a  problem  which  is  t undamenta 1 ly  very  complex. 
In  spite  of  this,  even  the  first  approx ima t ions  provide  useful  results. 
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The  Neumann  aeries  iterations  represent  multiple  scattering  of  the 
incident  wave.  This  interpretation  appears  to  be  useful  even  if  the 
Neumann  aeries  expansion  does  not  converge.  What  is  needed  is  a 
method  for  interpreting  the  divergent  part.  W.  P.  Srown  (1967)  has 
used  a  selective  summation  method  to  interpret  a  divergent  Neumann 
aeries  expansion.  The  basic  idea  of  the  selective  summation  technique 
is  to  identify  the  terms  in  the  Neumann  series  that  causes  the  diver¬ 
gence,  and  to  sura  these  terms  to  obtain  a  closed-form  expression  for 
the  multiple  scattering  effects. 

In  the  degenerate  kernel  method,  we  do  have  a  closed  form 
expression  for  the  spectral  representation  of  the  wave  function. 

However,  when  we  attempt  to  compute  the  power  spectral  density  and 
the  coherence  functions  by  expanding  the  denominator  of  the  resolvent 
kernel  in  a  power  aeries,  vt  may  obtain  a  divergent  power  series. 

In  this  case,  the  power  series  expansion  is  not  an  essential  part 
of  the  solution,  it  is  just  a  computational  method.  If  it  does  not 
work,  other  methods,  such  as  the  nonlinear  random  transformation  methods 
(Middleton,  1960;  and  Oeutsch,  1962)  must  be  used.  Application  of 
the  nonlinear  random  transformation  techniques  is  complicated  and 
it  is  a  major  topic  in  itself.  Development  oi  such  computational 
methods  would  be  a  possible  extension  of  this  work.  Other  extensions 
o£  this  work  are  discussed  in  the  concluding  chapter. 


CHAPTER  V 


CONCLUSIONS,  APPLICATIONS  AND  EXTENSIONS 
In  the  diverse  areas  of  electrical  engineering,  problems  arise 
which  should  be  properly  described  by  linear  differential  equations 
with  stochastic  coefficients.  In  most  cases,  the  randomness  of  the 
coeflicier-s  has  been  ignored  because  no  widely  applicable  methods 
have  beer  known  for  solving  such  problems.  In  this  dissertation,  an 
nC^  order  linear  differential  equation  with  such  stochastic  coefficients 
has  been  considered.  It  is  assumed  that  the  coefficients  of  the  differ¬ 
ential  equation  are  separable  into  deterministic  and  stochastic  parts. 

In  the  case  of  ordinary  stochastic  differential  equations,  the  problem 
now  becomes  a  problem  of  solving  a  Volterra  integral  equation  with  a 
stochastic  kernel.  Two  methods  of  solution  are  considered:  the  Neumann 
series  expansion  and  the  degenerate  kernel  method.  The  Neumann  series 
expansion  is  an  expansion  in  terms  of  iterated  integrals.  A  theorem 
which  gives  sufficient  conditions  for  the  uniform  convergence  of  the 
Neumann  series  expansion  is  proved.  The  proof  of  this  theorem  and 
the  actual  Neumann  series  expansion  is  facilitated  if  the  n**1  order 
difterential  equation  is  expressed  as  n  first-order  differential 
equations.  This  formulation  has  the  additional  advantage  of  using 
the  notation  and  terminology  of  the  state-space  formulation  of  modern 
contre.  ystem  theory.  (This  clarifies  the  connection  between  this 
work  and  the  control  system  problems.) 


The  uni for*  convergence  of  Che  Neumann  eerie*  expansion  allow# 
the  solution  of  the  stochastic  differential  equation  to  be  expressed 
in  tarsia  of  the  resolvent  kernel  of  the  stochastic  integral  equation. 
The  ensemble  average  and  covariance  function  of  the  solution  are 
expressed  in  terms  of  the  corresponding  statistical  measures  of  the 
racolvent  kernel  and  of  the  input  process.  The  statistical  measures 
of  the  resolvent  kernel  are  function*  of  the  Green1 a  function  of  the 
deterministic  operator  and  appropriate  statistical  measures  of  the 
stochastic  coefficients.  These  results  constitute  a  generalization 
of  ths  corresponding  expressions  for  linear  time-varying  systems  to 
th a  linear  randomly  time-varying  systems.  The  kernels  of  the  Integral 
expressions  for  the  statistical  measures  of  the  solution  can  be  inter¬ 
preted  as  stochastic  Green's  functions. 

The  construction  of  the  resolvent  kernel  by  means  of  the  Neumann 
series  expansion  is,  however,  extremely  laborious.  For  this  reason, 
other  methods  of  solving  the  integral  aquation  with  the  stochastic 
kernels  were  investigated.  When  the  deterministic  part  of  the 
stochastic  differential  operator  la  time- invariant,  the  separation 
of  the  stochastic  and  daterminlstlc  parts  of  th*  differantial  operator 
glvea  a  Voltarra  Integral  equation  with  a  degenerate  kernel.  In  solving 
this  Voltarra  Integral  equation,  we  still  have  to  resort  to  Neumann 
series  expansion.  From  the  a mdpolnt  of  computational  difficulty 
and  convergence  of  the  solution,  Chars  is  no  essential  difference 
between  the  straight  Neumann  serias  expansion  and  the  degenerate 
kernel  approach.  Selection  of  the  method  depends  on  the  phyeicsl 
problem  end  computational  convenience.  For  example,  in  the  esse  of 
e  time- invar  lent  deterministic  part,  the  transition  matrix  may  be 
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already  known  and,  therefore,  the  degenerate  kernel  method  may  be 
convenient.  In  the  case  of  the  time-varying  deterministic  part, 
the  straight  Neumann  series  expansion  is  more  convenient  than  the 
degenerate  kernel  method. 

Thus,  we  have  two  complementary  methods  for  solving  stochastic 
Volterra  integral  equations.  The  degenerate  kernel  method  is  also 
important  in  that  many  arbitrary  nondegenerate  kernels  can  be 
approximated  by  degenerate  kernels.  Other  approximate  methods,  such 
as  the  method  of  moments,  are  equivalent  to  the  replacement  of  an 
arbitrary  kernel  with  a  degenerate  kernel.  Other  methods,  such  as 
the  Fredholm  method  and  the  Hilbert-Schmidt  method  do  not  offer  any 
computational  advantages  for  solving  this  problem.  To  use  the  Hilbert- 
Schmidt  method  with  unsymmetr ica 1  kernels,  one  has  to  solve  a  pair  of 
integral  equations  of  the  first  kind.  This  problem  is  no  les6  diffi¬ 
cult  than  solving  the  integral  equations  of  the  second  kind.  The 
Fredholm  theory  has  been  very  important  in  the  development  of  the 
classical  integral  equation  theory,  but  to  use  the  Fredholm  method 
for  construction  of  the  resolvent  kernel  is  prohibitively  difficult 
in  practice. 

Both  the  Neumann  series  expansion  and  the  degenerate  kernel  method 
are  very  laborious.  In  pr  tical  computation,  >ne  must  still  resort 
to  the  truncation  of  the  Neumann  series  expansions.  The  iterative 
procedure  makes  it  possible  to  improve  the  approximations,  because 
the  truncation  of  the  series  is  made  almost  as  the  last  step  in  the 
solution.  In  other  methods,  such  as  in  the  hierarchy  methods  or  in 
methods  which  use  approximate  differential  equations,  the  approxima¬ 
tions  are  made  at  the  beginning  of  the  problem.  To  improve  the6e 
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approximations,  one  must  essentially  rework  the  whole  problem.  The 
method  suggested  here  does  not  have  this  disadvantage. 

It  can  be  seen  from  the  expressions  for  the  covariance  function 
of  the  solution  that  the  knowledge  of  all  the  moments  of  the  stochastic 
coefficients  is  required  for  the  complete  solution  of  the  problem.  If 
only  the  second-order  statistics  of  the  coefficients  are  known  only 
an  approximate  solution  of  rhe  problem  is  possible.  This  approximate 
solution  can  be  obtained  from  the  first-order  approximat ion  of  the 
Neumann  series  expansion.  An  exceptional  case  is  that  in  which  the 
stochastic  coefficientr  are  Gaussian  processes.  Then,  the  knowledge 
of  the  second-order  statistics  is  sufficient  for  the  complete  solution 
of  the  problem. 

Both  the  Neumann  series  iteration  and  degenerate  kernel  approxi¬ 
mation  were  applied  to  the  investigation  of  the  propagation  of  waves 
in  a  randomly  space-  and  time-varying  medium.  Almost  all  the  previous 
work  has  used  the  so-called  quas imonochromat ic  assumption  which  essen¬ 
tially  neglects  the  time  variation  of  the  medium.  Such  an  assumption 
has  been  avoided  in  this  dissertation.  To  solve  the  problem,  all  the 
stochastic  quantities  of  the  scalar  wave  equation  are  expressed  by 
»hei’  spectral  representation  and  the  equation  is  solved  for  the 
spectral  representation  of  the  scalar  wave  function.  From  the  spectral 
representation  of  the  scalar  wave  tunction,  its  power  spectral  density 
and  mutual  coherence  functions  can  be  found.  Both  the  Neumann  series 
expansion  and  the  degenerate  kernel  approximation  demonstrate  the 
spreading  of  the  power  spectrum  of  the  source  by  the  time-varying 
medium.  In  the  Neumann  series  expansion,  even  the  first-order 
approximation  shows  the  spreading  of  the  power  spectrum.  Higher  order 


159 


approximations  show  further  spreading  of  the  power  spectrum.  The 
successive  convolution  of  the  power  spectrum  of  the  source  term  with 
the  power  spectrum  of  the  random  coefficient  shows  a  further  spread 
of  the  power  spectral  density  of  the  wave  function,  making  the 
correlation  time  of  the  wave  function  shorter.  This  agrees  with  the 
intuitive  concept  that  multiply-scattered  waves  become  decorrelated. 

The  quasimonochroma  tic  assumption  does  not  show  any  spreading  of  the 
power  spectrum. 

Another  interesting  phenomenon  is  demonstrated  by  both  methods 
of  solution.  The  first  term  of  the  solution  (zeroC^  approximation) 
is  the  solution  of  the  wave  equation  in  the  non-random  medium.  When 
the  next  approximation  is  used,  the  wave  function  is  a  wide-sense 
stationary  stochastic  process  (if  the  source  and  the  stochastic  medium 
are  wide-sense  stationary  processes).  If  the  higher  order  approxima¬ 
tions  are  used,  the  solution  contains,  in  addition  to  the  wide-aense 
stationary  terms,  terms  which  are  no  longer  wide-sense  stationary. 

Thus  the  power  spectral  density  must  be  expressed  as  a  bifrequency 
Fourier  transform  of  the  mutual  coherence  function  C(K^ ,R^ , t ^ , t^ ) . 

The  mutual  coherence  tunction  is  written  in  the  above  form  to  6how 
that  it  is  a  function  ot  the  actual  observation  time6,  and  t^,  not 
just  the  difference  ot  the  observation  times.  Because  of  the  close 
relationship  between  the  coherence  tunction  and  optical  images,  one 
would  expect  fluctuation  of  the  images  which  have  been  termed  from 
light  that  is  propagated  through  a  randomly  time-varying  medium.  Under 
unfavorable  astronomic.)  1  observation  conditions,  twinkling  and  quivering 
of  the  stellar  images  is  indeed  connion.  The  existence  ot  the  nonsta 
tionarv  mutual  coherence  tunc  lions  nt.iv  t>e  expected  to  be  useful  In 
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studying  nonstationary  optical  images.  Lip  to  now,  almost  no  work 
has  been  done  in  studying  the  properties  of  the  mutual  coherence 
functions  in  randomly  time-varying  media.  The  use  of  nonstationary 
coherence  functions  may  be  useful  in  the  investigation  of  the  factors 
which  limit  the  performance  of  the  optical  and  radio  interferometers 
and  high  gain  arrays. 

An  interesting  future  area  of  work  i6  development  of  the  statis¬ 
tical  communication  theory  for  multiplicative  interference.  Statistical 
comnunicat ion  theory  has  been  based  almost  completely  on  the  assumption 
that  the  interference  ha6  been  added  to  the  signal.  This  assumption 
la  clearly  not  valid  when  one  is  working  with  rapidly  fading  signals 
or  with  aignala  that  have  been  scattered  by  randomly  time-varying  media. 
Besides  the  usual  additive  noise,  one  has  multiplicative  noise.  A 
useful  approach  to  communication,  radar  or  6onar  system  design  would 
be  to  solve  first  the  wave  propagation  problem  through  the  stochastic 
medium.  Then,  the  solution  could  be  used  to  design  the  optimum  signals 
and  signal  processor.  The  actual  solution  oi  the  problem  may  be  very 
complicated  and,  for  tractability,  one  probably  would  have  to  base 
the  analysis  on  the  first  approximation  in  the  Neumann  aeries  expansion 
in  the  same  manner  as  was  done  here. 

There  are  a  number  of  interesting  applications  of  this  work  in 
control  system  theory.  The  obvious  ones  sre  the  cases  where  the 
system  parsme'ers  change  randomly  with  time.  For  example,  the  center 
of  gravity  or  tue  moment  ot  inertia  of  a  controlled  vehicle  changes 
due  to  motion  ot  fuel  in  tanks  or  due  to  a  change  ot  operating  condi¬ 
tions.  The  sensitivity  analysis  ot  control  systems  can  also  be  based 
on  atochastlc  differential  equation  theory.  It  the  sensitivity  of  the 
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controlled  variable  to  the  change  of  a  certain  parameter  is  to  be 
investigated,  it  may  be  assumed  that  this  parameter  i6  a  random 
variable.  Then,  the  stochastic  differential  equation  is  solved  for 
a  desired  statistical  measure  of  the  controlled  variable  or  error 
term.  The  solution  is  in  terms  of  the  Green's  function  (impulse 
response)  of  the  system  and  the  statistical  measures  of  the  random 
parameter.  This  functional  relation  constitutes  a  solution  to  the 
sensitivity  problem.  Incompletely  identified  control  systems  may 
also  be  treated  as  stochastic  systems.  In  such  cases,  statistical 
measures  of  the  system  parameters  are  determined  instead  of  a  precise 
analytical  expression  for  the  coefficients. 

In  addition  to  the  application  of  stochastic  operator  theory  to 
control  system  and  communication  theory,  it  may  be  applied  as  a  method 
for  investigating  the  atochastic  medium  itself.  For  example,  the  aun 
haa  been  used  as  a  source  of  random  signals  to  investigate  the  propa¬ 
gation  of  microwave  signals  through  the  atmosphere  from  the  sun  to 
a  receiver  on  the  earth.  Measurements  ot  this  type  are  used  to  predict 
the  propagation  of  signala  between  an  orbiting  coosnunica  t  ion  satellite 
and  s  ground  station.  Mathematically,  such  s  problem  is  completely 
analogous  to  the  wave  propagation  problem  considered  here.  Many  other 
examples  of  this  type  can  be  cited.  Among  these  would  be  invest ige t ion 
of  plasmas  by  microwave  and  laser  signals. 

While  a  number  of  Interesting  results  have  been  obtained  in  this 
dissertation,  the  work  is  far  from  being  complete.  Many  useful  and 
Interesting  extensions  can  be  suggested.  Specific  problems  should 
be  worked  out  in  great  detail  to  checx  the  practical  utility  of  the 
computational  methods.  Problems  should  be  realistically  selected  so 
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that  the  numerical  results  can  be  compared  with  the  experimental  results. 
An  example  of  this  is  an  electromagnetic  wave  propagation  problem.  The 
atatiatical  measures  of  the  medium's  dielectric  permittivity  should  be 
determined  exper iraenta 1 ly  or  derived  theoretically  from  the  theory  of 
turbulence.  Then,  the  wave  equation  should  be  solved  for  the  statisti¬ 
cal  measure  of  interest,  e.g.,  the  mutual  coherence  function.  Then,  the 
mutual  coherence  function  should  be  measured  experimentally  to  check  the 
ability  of  the  theory  to  predict  physical  phenomenon.  The  various  ex¬ 
perimental  methods  for  measuring  the  mutual  coherence  function  are 
discussed  in  the  IEEE  special  issue  on  partial  coherence,  (1967)  and  by 
Handel  and  Wolf  (1965)  in  their  review  paper. 

Experimental  comparisons  are  also  possible  in  control  system 
problems.  A  control  systems  problem  could  be  solved  by  the  methods  of 
Chapter  III,  and  the  results  could  be  compared  with  a  hybrid  computer 
simulation.  The  stochastic  coefficients  of  the  differential  equations 
can  be  simulated  by  noise  modulating  the  coefficient  potentiometers  of 
the  operational  amplifiers  in  the  analogue  portion  of  the  computer.  In 
such  a  retup,  the  analogue  part  of  the  computer  solves  the  stochastic 
differential  equation  for  a  sample  function  (or  realixation)  of  the 
dependent  variable-  Computations  are  repeated  for  a  large  number  of 
Clows  and  each  date  sample  solutions  are  stored  in  the  computer's 
memory.  Then,  the  desired  statistical  measures,  such  as  mean  and 
correlation  function,  are  computed  by  the  digital  portion  of  the 
computer  from  the  stored  sample  solutions-  Then  the  simulated  results 
may  be  compared  with  the  result*  obtained  by  either  of  the  two  method* 
in  Chapter  Ill.  It  may  be  expected  that  the  mathematical  method* 
developed  in  thia  d iaaertet ion  would  provide  *  systematic  procedure  for 
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understanding  and  interpretation  of  the  result*  which  are  obtained 
in  simulation  of  systems  with  stochastic  parameters. 

A  number  of  generalizations  and  improvements  to  this  work  can  be 
suggested.  in  the  degenerate  Kernel  method,  it  would  be  useful  to 
find  methods  other  than  the  power  series  expansion  for  computation 
of  the  statistical  measures  of  the  inverse  matrix.  Application  of 
nonlinear  transformation  echniques  may  be  useful  in  special  cases. 

If  tractable  computational  methods  can  be  developed,  the  troublesome 
convergence  problem  of  the  power  series  expansion  can  be  avoided. 

This  would  be  especially  valuable  in  the  wave  propagation  problem. 

It  is  desirable  to  eliminate,  in  the  wave  propagation  problem,  the 
assumption  that  the  dielectric  p  .mittivity  is  a  wide-sense  stationary 
stochastic  process.  A  canonical  Integral  expansion  (Pugachev,  1965) 
of  the  stochastic  processes  snould  oe  used  instead  of  the  spectral 
representation,  which  is  a  special  case  of  integral  expansions  for 
the  wide-sense  stationary  stochastic  processes.  The  solution  with 
non  t«  t  iona  ry  coefficients  can  be  expected  to  be  more  difficult  than 
the  wide-seti6e  stationary  case,  since  the  familiar  Fourier  tranaiorm 
techniques  are  not  uirectly  applicable. 

In  Chapter  IV,  propagation  of  a  scalar  wave  function  in  a  stochaa 
tic  medium  was  considered  An  obvious  generalization  of  this  i*  the 
ooiution  of  the  stochastic  vector  wave  equation.  The  statistical 
measure  of  interest  in  this  ctse  is  ct>e  coherency  matrix  (Born  and 
Wolf,  19t>4).  The  coherency  matrix  with  elements  in  a  cartesian 
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can  be  used  to  study  the  change  of  polarization  of  a  wave  as  it 
propagates  through  a  stochastic  medium.  It  is  conjectured  that 
the  Green’s  dyadica  (Levine  and  Schwinger,  1951;  and  Van  Bladel,  1964) 
can  be  used  to  cind  the  statistical  measures  of  the  stochastic  vc.cor 
wave  equation.  The  mathematical  manipulations  with  the  Green' a  dyadics 
are  more  complicated  than  the  use  of  scalar  Green's  functions,  but  the 
general  procedure  *or  construction  of  stochastic  Gree  's  functions 
(or  possibly  stochastic  Green's  dvads)  would  be  analogous  to  the  scalar 
case.  This  problem  would  constitute  a  generalization  of  the  stochastic 
scalar  wave  equation  solution  to  the  stochastic  vector  case. 
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